Systems and Methods for Ordering and Preparation of Customized Comestibles

ABSTRACT

In an illustrative embodiment, systems for designing and producing customized food products include receiving a request to design a customized food product containing a printed edible medium. The systems may calculate, based on product inventory at a preferred bakery, a preparation lead time for the food product where the product inventory includes availability of printed edible media substrates. The systems may present customization user interface screens that provide customization options for the food product. The systems may convert customization option selections made at the customization user interface screens into decorating instructions for the food product and transmit the decorating instructions to the bakery. The systems may determine a position in a preparation queue for the food product based in part on attributes of pending food product orders in a preparation queue at the bakery.

RELATED APPLICATIONS

This application claims priority to U.S. Provisional Patent ApplicationSer. No. 62/776,872, entitled “Systems and Methods for Ordering andPreparation of Customized Comestibles,” filed Dec. 7, 2018.

This application is related to the following prior patent applications:U.S. Pat. No. 9,743,687, entitled “Decorating System for Edible Items”and filed on May 27, 2016, which is a continuation-in-part of U.S.patent application Ser. No. 13/287,023 entitled “Online DecoratingSystem for Edible Items” and filed on Nov. 1, 2011, now U.S. Pat. No.9,713,342, which is a continuation-in-part of U.S. patent applicationSer. No. 12/852,988, entitled “Decorating System for Edible Products”and filed on Aug. 9, 2010; U.S. patent application Ser. No. 10/925,459,entitled “Decorating System for Edible Items” and filed on Aug. 25,2004, now U.S. Pat. No. 7,012,712; U.S. patent application Ser. No.14/553,884, entitled “Online Decorating System for Edible Products” andfiled on Nov. 25, 2014, now U.S. Pat. No. 9,282,750 and is acontinuation of U.S. patent application Ser. No. 13/287,023, entitled“Online Decorating System for Edible Products” and filed on Nov. 1,2011, now U.S. Pat. No. 9,713,342; U.S. patent application Ser. No.14/569,224, entitled “Online Decorating System for Edible Products” andfiled on Dec. 12, 2014, now U.S. Pat. No. 9,314,050 and is acontinuation of U.S. patent application Ser. No. 13/287,023, entitled“Online Decorating System for Edible Products” and filed on Nov. 1,2011, now U.S. Pat. No. 9,713,342; U.S. patent application Ser. No.14/569,042, entitled “Online Decorating System for Edible Products” andfiled on Dec. 12, 2014, now U.S. Pat. No. 9,345,264, which is acontinuation of U.S. patent application Ser. No. 13/287,023, entitled“Online Decorating System for Edible Products” and filed on Nov. 1,2011, now U.S. Pat. No. 9,713,342; U.S. patent application Ser. No.14/194,000, entitled “Decorating System for Edible Products” and filedon Feb. 28, 2014, now U.S. Pat. No. 10,019,842, which is acontinuation-in-part of U.S. patent application Ser. No. 12/852,988,entitled “Decorating System for Edible Products” and filed on Aug. 9,2010; U.S. patent application Ser. No. 14/492,620, entitled “DecoratingSystem for Edible Products” and filed on Sep. 22, 2014, which is Pendingand is a continuation-in-part of U.S. patent application Ser. No.12/852,988, entitled “Decorating System for Edible Products, and filedon Aug. 9, 2010; U.S. patent application Ser. No. 15/157,142, entitled“Three-Dimensional Decorating System for Edible Items” and filed on May17, 2016 which is Pending and is a continuation-in-part U.S. patentapplication Ser. No. 13/287,023, entitled “Online Decorating System forEdible Products” and filed on Nov. 1, 2011, now U.S. Pat. No. 9,713,342;and U.S. patent application Ser. No. 15/164,545, entitled “DecoratingSystem for Edible Items” and filed on May 25, 2016, now U.S. Pat. No.9,907,332, which is a continuation-in-part U.S. patent application Ser.No. 13/287,023, entitled “Online Decorating System for Edible Products”and filed on Nov. 1, 2011, now U.S. Pat. No. 9,713,342; each of which isalso incorporated herein by reference.

BACKGROUND

Decorative food products, such as cakes, are popular items, particularlyfor special occasions, such as birthdays, holidays, weddings,anniversaries and other celebratory events. These items are typicallypurchased from bakeries since the items generally require some skilland/or apparatus to create. Previously, these items were created fromcolored frostings applied manually by trained bakery decorators. Forexample, pre-made decorative items can be placed on a food product.These pre-made items are generally produced in bulk in a factory andinventoried until use. The use of such pre-made decorative itemsprecludes uniquely decorated and/or personalized decorations. Also,these pre-made decorative items are generally pre-ordered, whichrequires a long lead time, or stored in inventory at the risk ofunder-ordering or over-ordering, as well as the cost of such inventory.

Another alternative has been to utilize an automated system fordecorating cakes. One such system is disclosed in U.S. Pat. No.5,505,775, issued to Kitos. This system utilizes an integrated worksurface controlled with a computer system. A 2-dimensional image isscanned into the computer system. The computer system then uses a motioncontrol system to manipulate a drop-on-demand colorant expulsion systemover a cake carried on the work surface to reproduce the scanned image.This system produces the decorations and images directly onto the foodproduct.

An automated system for printing images onto edible media, that can thenbe applied to a food product or consumed as is, is disclosed in U.S.Pat. No. 7,286,258, issued to Schnoebelen et al., which is incorporatedby reference herein. This system discloses a local processing unit and anumber of image sources, including a scanner and a database of digitalimages stored on a local computer memory system. The user selects animage from one of the image sources and prints the image onto an ediblemedia.

A decorating system for edible items is disclosed in U.S. Pat. No.7,012,712, issued to Spurgeon et al., which is incorporated herein byreference. This system discloses creating a decorative edible item froma selected image. The system includes at least one image source, such asa scanner and/or a library of stored images, a controller unit and aprinter for creating a high-quality pictorial rendition of the image.The printed edible media can then be applied onto a product, shipped toa separate location or eaten as is.

Various websites exist for allowing users to customize decorations. Onesuch online website is www.genometri.com which allows users to decorateand purchase customized decorated cakes. Users can choose frompre-designed decorative templates or can choose to customize their cakedecoration. Users can upload personal photographs to use in the cakedecoration and can add text and clip art to the cake decoration. Whenthe user is finished decorating the cake, the user purchases a cakedecorated with the customized decoration. The purchase transaction isprocessed through the website.

SUMMARY OF ILLUSTRATIVE EMBODIMENTS

The forgoing general description of the illustrative implementations andthe following detailed description thereof are merely exemplary aspectsof the teachings of this disclosure and are not restrictive.

In some embodiments, systems for designing and producing customized foodproducts include receiving a request to design a customized food productcontaining a printed edible medium. The systems may calculate, based onproduct inventory at a preferred bakery, a preparation lead time for thefood product where the product inventory includes availability ofprinted edible media substrates. The systems may present customizationuser interface screens that provide customization options for the foodproduct. The systems may convert customization option selections made atthe customization user interface screens into decorating instructionsfor the food product and transmit the decorating instructions to thebakery. The systems may determine a position in a preparation queue forthe food product based in part on attributes and decorating instructionsfor pending food product orders in a preparation queue at the bakery.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate one or more embodiments and,together with the description, explain these embodiments. Theaccompanying drawings have not necessarily been drawn to scale. Anyvalues dimensions illustrated in the accompanying graphs and figures arefor illustration purposes only and may or may not represent actual orpreferred values or dimensions. Where applicable, some or all featuresmay not be illustrated to assist in the description of underlyingfeatures. In the drawings:

FIG. 1A illustrates an example system for designing and producingcustomized food products with edible media;

FIGS. 1B-1E show examples of edible media that are 3D printed on a foodproduct;

FIGS. 1F-1H show a cross section of a 3D edible media;

FIG. 1I shows a perspective view of a printer having a printheadconnected to a printer frame and a stationary platform;

FIG. 1J shows a drawing of a printer having a jointed movable printheadand a maneuverable platform according to an example

FIG. 1K illustrates an example system for designing and producingcustomized food products with edible media;

FIG. 1L illustrates an example system for designing and producingcustomized deli food products with edible media;

FIG. 2 is an example computing system including software engines in acentral control device in a system for designing and producingcustomized food products with edible media;

FIGS. 3A-3C illustrate a flow chart for a method of designing acustomized food product;

FIG. 4 illustrates a flow chart for a method of interacting with asystem for designing and producing customized food products with ediblemedia through a kiosk;

FIGS. 5A-5B illustrates a work flow for presenting cake customizationuser interface screens at a computing device;

FIGS. 6A-6R illustrate example user interface screens for designing acustomized cake product;

FIGS. 7A-7D illustrate example user interface screens for supplying aphoto for a customized cake product;

FIG. 8 illustrates an example bakery administrative user interfacescreen for preparing customized cake products;

FIG. 9 is a block diagram of an example computing system; and

FIG. 10 is a block diagram of an example distributing computingenvironment including a cloud computing environment.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

The description set forth below in connection with the appended drawingsis intended to be a description of various, illustrative embodiments ofthe disclosed subject matter. Specific features and functionalities aredescribed in connection with each illustrative embodiment; however, itwill be apparent to those skilled in the art that the disclosedembodiments may be practiced without each of those specific features andfunctionalities.

Reference throughout the specification to “one embodiment” or “anembodiment” means that a particular feature, structure, orcharacteristic described in connection with an embodiment is included inat least one embodiment of the subject matter disclosed. Thus, theappearance of the phrases “in one embodiment” or “in an embodiment” invarious places throughout the specification is not necessarily referringto the same embodiment. Further, the particular features, structures orcharacteristics may be combined in any suitable manner in one or moreembodiments. Further, it is intended that embodiments of the disclosedsubject matter cover modifications and variations thereof.

It must be noted that, as used in the specification and the appendedclaims, the singular forms “a,” “an,” and “the” include plural referentsunless the context expressly dictates otherwise. That is, unlessexpressly specified otherwise, as used herein the words “a,” “an,”“the,” and the like carry the meaning of “one or more.” Additionally, itis to be understood that terms such as “left,” “right,” “top,” “bottom,”“front,” “rear,” “side,” “height,” “length,” “width,” “upper,” “lower,”“interior,” “exterior,” “inner,” “outer,” and the like that may be usedherein merely describe points of reference and do not necessarily limitembodiments of the present disclosure to any particular orientation orconfiguration. Furthermore, terms such as “first,” “second,” “third,”etc., merely identify one of a number of portions, components, steps,operations, functions, and/or points of reference as disclosed herein,and likewise do not necessarily limit embodiments of the presentdisclosure to any particular configuration or orientation.

Furthermore, the terms “approximately,” “about,” “proximate,” “minorvariation,” and similar terms generally refer to ranges that include theidentified value within a margin of 20%, 10% or preferably 5% in certainembodiments, and any values therebetween.

All of the functionalities described in connection with one embodimentare intended to be applicable to the additional embodiments describedbelow except where expressly stated or where the feature or function isincompatible with the additional embodiments. For example, where a givenfeature or function is expressly described in connection with oneembodiment but not expressly mentioned in connection with an alternativeembodiment, it should be understood that the inventors intend that thatfeature or function may be deployed, utilized or implemented inconnection with the alternative embodiment unless the feature orfunction is incompatible with the alternative embodiment.

Aspects of the present disclosure are directed to a system for designingand producing customized food products with edible media. In someimplementations, the system allows consumers to design a customized foodproduct that include printed edible media, such as a cake, without anyor very few interactions with a bakery. For example, the system canpresent a number of user interface screens at a remote computing devicethat allow the consumer to identify the size, shape, cake and fillingflavor, icing flavor and color, design and placement of decorations aswell as upload and edit photos to be printed on edible media for thecustomized food product. In some embodiments, the system maintains aninventory status for bakeries that interact with the system and isconfigured to present to consumers designing and producing customizedfood products only those customization options that are available at aselected bakery based on the inventory status for that bakery. Further,the system can be configured to calculate and update a lead time forpreparing the customized food product based upon the customizationselections that are made by the consumer, inventory status at theselected bakery, and a current workload at the selected bakery (e.g.,other pending custom food product orders).

In some implementations, the system is configured to provideadministrative functions to bakeries through a number of administrativeuser interface screens. For example, upon receiving a submitted orderfrom a consumer, the system can convert the order information intodecorating instructions for the customized food product, which aretransmitted to a remote computing system for the bakery. Based on aworkload at the bakery receiving a customized food product order, thesystem can determine an order of preparation for the food product ordersbased on the lead times for each product, inventory status at thebakery, and desired pickup date for each order. In some examples, thesystem can determine an optimal order for printing edible media for thepending food product orders at a bakery to maximize throughput. Byallowing consumers to design customized food products with edible mediafrom start to finish in a closed loop cake ordering ecosystem, thesystem solves the problem of providing consumers the ability to haveknowledge and control over what the completed customized food productwill look like without having information lost in translation betweenthe consumer and the bakery. Further, the system also provides theadditional benefit of automatically managing inventory and pending orderstatus at bakeries, which improves throughput and efficiency.

In some embodiments, the system for designing and producing customizedfood products with edible media also allows consumers to design delifood products with customized edible media and designs for products thatinclude deli trays (e.g., cheese and cracker trays, fruit and vegetabletrays, chips and dip trays), pizza, sandwiches, hamburgers, and hotdogs. Additionally, customized deli food products can also includefruits or vegetables (e.g., melons, squash) that have customized etchingdesigns applied to an outer skin or surface of the fruits or vegetableswith laser etchers/printers that are communicatively coupled to thesystem. Like the dessert-based food products, consumers can also designcustomized deli food products from start to finish in a closed loopordering ecosystem by interacting with a web-based application providedby the system without any additional communication or interactions withthe deli and with capability for intervention by deli employees ifnecessary.

FIG. 1A is an example system 100 a for designing and customizing media102. The system 100 provides an online environment for designing andcustomizing edible media. In some implementations, the onlineenvironment includes one or more web-based applications with whichconsumers can interact to design customized food products. The system100 a can provide a mechanism to perform online or local searching ofimages and customization of images as well as a mechanism for receivingimages uploaded from a remote image source 104 of a consumer (e.g.,laptop, tablet, mobile device, or digital camera). In some examples, thesystem 100 a enables consumers to design and customize an entire foodproduct (e.g., cookies, cakes, pizza, cupcakes, candy bars, edibletattoos, temporary tattoos, cereal boxes, waffles, and pancakes), whichmay include selecting edible media design and decorative attributes(e.g., cake flavor, icing colors, placement of decorative elements) forthe food product. In some implementations, the system 100 a converts thedecorative attributes for the food product to decorating instructions,which are transmitted with the edible media design to a local controldevice 128 at a bakery.

As used herein, an image can be any work protected by a copyright,registered copyright and/or a registered trademark including a regularimage or photograph, a digital image, a fictional character, acelebrity, an emblem, a logo, a mascot, an illustration, a pictorial, agraphic, as well as works not in image form such as sculptural works,which include two- and three-dimensional works of fine, graphic, andapplied art. An image can include an image protected by a commerciallicense. An image can include a series or collection of two or moreimages, a schematic, and a computer aided design (CAD) file for derivingor rendering a 2D or 3D form or object. In an example, the 2D or 3D formor object can be a figurine that is based on a copyrighted character ora generic body of a part of a figurine. Further, an image can alsoinclude derivatives of the copyrighted works and the trademarked works,as well as any other original work including non-copyright protectedimages or unpublished work such as personal photographs, digital images,videos, illustrations, clip art, and other original works. In anexample, the 2D or 3D form or object can have 2D elements or 3D elementsthat can be customized, such as size, color, and features that can bemerged with user data for a personalized birthday kid (e.g. image offace of kid on the figurine, etc.).

As used herein, edible media can be any two-dimensional orthree-dimensional ingestible product. In an example, edible media may bea baked good such as a cake, cupcake, cookie, or pizza crust. In anotherexample, edible media may be temperature-sensitive media such as an icecream cake, ice form, or gelatin. In a further example, edible media maybe a planar printable surface such as edible paper, wafer, or ediblemedia sheet. In an additional example, edible media may be athree-dimensional edible confection such as an off-the-shelf edibledecoration (e.g., SugarSoft® Decorations by DecoPac, Inc. of Anoka,Minn.), candy, or chocolate.

As used herein, printable base media can be any two-dimensional orthree-dimensional nontoxic product used as a base for printingtwo-dimensional or three-dimensional edible decorations. In an examplethe printable base media can be the food product. In an example, theprintable base media can include edible media, as described above. Inanother example, printable base media can include a planar nontoxicmaterial such as a flat plastic base material, a flat metal basematerial, or a flat paper or cardboard base material (e.g., a cakeboard), a silicon transfer sheet, or a wax paper transfer sheet. In afurther example, printable base media can include a formed nontoxicmaterial such as a ring form (e.g., to be worn on the finger as a ringpop) or a stem form (e.g., popsicle stick with planar printing surfaceonto which an edible decoration can be printed). In additional examples,a printable base media may be printed prior to printing of an edibleitem. In a particular example, the printable base media can be a 3Dprinted flower stem form that can be made from an edible or inediblematerial unto which the secondary shape, edible or nonedible, may beprinted, such as a flower.

The system 100 a is operated by consumers and bakery personnel to designcustomized food products and print and/or customize images for 2D and/or3D edible media including both licensed and non-licensed digital imagesassociated with the customized food products. The system 100 aadditionally provides digital rights management, print monitoringfunctions, user account management, and messaging functions.

The system 100 a manages both licensed and non-licensed images forpurposes of obeying licensing laws when printing the images on an ediblemedium. Licensed digital images, such as copyrighted images includingfictional characters, celebrities, emblems, logos, mascots,illustrations, or photographs having licensing terms and conditions forusage can be purchased from one or more online sources. In an example,the image can be a grouping of multiple 3D elements such as a set ofindividual characters (e.g., a feature film character set).

Non-licensed digital images such as personal photographs, illustrations,clip art, or other non-copyright protected images can be uploadedlocally to the system 100 from a remote image source 104. In someexamples, both licensed and non-licensed digital images can be retrievedfrom an external device or the Internet, stored locally, and uploaded tothe system 100 a. In some embodiments, a combination of licensed andnon-licensed digital images are retrieved either locally or online andprinted in combination on a single printable base media. In someembodiments, the uploaded digital files may be of a scannedthree-dimensional shape such as a person or thing.

In some implementations, consumers may access the online environment insystem 100 a to search, select, and edit images. In someimplementations, consumers and/or bakery personnel may also and purchaseimages for printing onto 2D or 3D edible media. The purchased images canbe printed onto the edible media 102 using edible inks. The consumerselects the image, purchases and/or edits the image, and directs thesystem 100 a to print the purchased image onto the edible media 102. Insome implementations, bakery personnel at bakery 112 can purchase theimages, which are provided to consumers for selection when designing thecustomized food product. In some examples, the images available tosystem 100 a can be retrieved from any number of sources includinglocal, online, or remote storage repositories. For example, images canbe retrieved from remote image sources 104 which are communicablyconnectable to system 100 a. The image sources 104 can include, but arenot limited to a digital camera 106, a video device 110, a laptopcomputer 114, a mobile device 116, a computer 108 available on a localnetwork 118, a scanner 121, a CD-ROM OR DVD, a flash drive, an externalhard drive, a netbook, a laptop, a wireless device (e.g., Wi-Fi enabled,Bluetooth enabled, or other wirelessly enabled device), or a handhelddevice such as a “smart” phone or tablet.

Images can also be retrieved via the network 118 from any number ofwebsites containing digital images or libraries of digital images.Images can additionally be retrieved from other networked or remotestorage repositories (not shown). Upon retrieving images, the system 100a provides access to additional features for handling retrieved images,such as photograph editing, social networking content insertion, oraugmented reality content insertion.

In some implementations, bakeries 112 can purchase edible media andother food product ingredients using one or more e-commerce sitesassociated with one or more third-party vendors 115. For example, thebakers 112 can purchase an edible sheet from an e-commerce siteincorporated into system 100 a. E-commerce sites associated with system100 a, for example, provide a number of selectable options for obtaining2D and 3D edible media materials. Bakery personnel, in someimplementations, can choose standard “off-the-shelf” edible media itemsor custom edible media items, which may be based in part on selectionsmade by consumers at a user interface 120 of a remote computing device.

In some configurations, the bakery 112 may be provided the option topurchase edible media locally using the system 100 a. For example, thebakery 112 may be offered several sizes of edible media for decorating.The bakery 112 can select a desired decoration size and choose an ediblemedia (e.g., an edible sheet of paper) size comparable to the desireddecoration size. The selected edible media (e.g., edible media 102) canbe purchased through the system 100 a by entering an appropriate ediblemedia code or by simply selecting the desired edible media onscreen. Theedible media code can, in effect, function as a part number for orderinga specific edible media sheet size. In some implementations, the ediblemedia code is requested by the system 100 a to prompt the bakery 112 toselect an edible medium available locally in the bakery 112, forexample. The selected edible medium can be loaded into the system 100 aand images can be printed upon the edible medium.

In certain embodiments, the system 100 a may request that the bakery 112enter a unique code. The unique code may be sent to the bakery 112 withedible media prior to accessing system 100 a. The unique code can beentered once by the bakery 112 to enable printing of images a specificnumber of times. For example, the bakery 112 can enter a code andreceive up to twenty-four print sessions for selected images. Inoperation, once the bakery 112 enters the code, the system 100 averifies that the code is valid and has not been used before. Inpractice, the bakery 112 may be limited to the specified print sessions.

Once the edible media has traveled through a printer 134 (e.g., a flatprinter 134 a or three-dimensional (3D) printer 134 b) and the imageprinted thereon with the edible inks, the printed edible media 102 isremoved from the printer 134. The printed edible media 102 is thenplaced on a food product at the point of printing or transported to aseparate location for application. In some configurations, the ediblemedia 102 is relatively thin and sturdy allowing for convenienttransport and thus minimization of damage to the decorations. In certainembodiments, the edible media 102 may also include an optional releasesheet having a silicon coating functioning as a backing material, forexample.

User Interface

In the system 100 a, user interface controls for a consumer applicationinterface 120 are connected to a consumer computing device 122 that isconnected to central control device 132 via the network 118. In someimplementations, the user interface controls 120 may include a keyboard,mouse, display device, or touchscreen interface. Other implementationsmay use other devices, such as a joy stick, remote control, or a voicecommand system. The user interface controls 120 allow the user tooperate the system 100 a to decorate edible media 102 or to displayedible media-related content on the display device. In one example avirtual headset can be used to display a virtual reality or an augmentedreality.

In some implementations, the user (for example, a consumer designing afood product that includes 2D and/or 3D edible medial) is displayed avariety of navigation screens and menus on the display of the consumercomputing device 122. The user selects desired options from thenavigation screens and menus using the keyboard, the mouse, touchscreen,or other input mechanism. In some examples, the user interface controls120 relay signals from the consumer computing device 122 to the centralcontrol device 132, thereby operating the system 100 a from the consumercomputing device 122. The GUI 127 can also be configured to switchbetween multiple software applications, including a software web browserand non-web browser software. In some configurations, the GUI 127 isconfigured to retrieve non-licensed images. In some embodiments, the GUI127 can be presented within a software web browser.

In some embodiments, the consumer computing device 122 can be configuredto display a Graphical User Interface GUI 127 for interacting with thehardware and software components of system 100 a. The GUI 127 can, forexample, include application screens, website content, softwarecontrols, and other Graphical User Interface content. In someimplementations, the GUI 127 is configured to receive user input foraccessing one or more licensed or non-licensed digital images. The GUI127 can, for example, include graphical elements provided in one or moreapplications. Consumers can interact with one or more graphical elementsto control the behavior and output of system 100 a components. In someexamples, the GUI 127 can also include graphical elements that allowconsumers to design and customize the food product from start to finishwithout interaction with the bakery 112. In one example where the foodproduct being designed is a cake, the consumer can interact with the GUI127 to upload and edit images for the edible media, select a type ofedible media, select size, shape, and flavor for the cake, select icingcolors and flavors, select and design 3D edible media, select decoratingsets that include a combination of background overlays and decorationsfor the cake, and identify placement of decorative elements and ediblemedia (see FIGS. 6A-6R and FIGS. 7A-7D).

In some aspects, the GUI 127 is configured to communicate with andcontrol the central control device 132 over network 118 to retrieve atleast one licensed digital image from the central control device 132. Inan example where the user interface controls 120 at the consumercomputing device 122 are part of a tablet or touch screen device, theGUI 127 can be further configured to interpret and communicate throughnetwork image manipulation inputs in order to generate decoratinginstructions for the food product that reflect the received networkimage manipulation inputs. For example, a network image manipulationinput through the GUI 127 can rotate a 3D image in order to change itsrespective center of mass and effect a base 170 needed, as determined bythe decorating instructions.

In some implementations, the GUI 127 is configured to allows consumersto select a preferred bakery 112 for preparing the customized foodproduct. In one example, the GUI 127 provides an interactive calendarfor viewing available pickup dates and times for the food product basedon the availability of the selected 2D and/or 3D edible media and otheringredients associated with the decorating instructions (for example, 3Dobjects, frosting ingredients, food coloring, edible ink) for theselected bakery. In some examples, the central control device 132 of thesystem 110 a is configured to dynamically adjust the available pickupdate/time displayed at the GUI 127 of the consumer computing devicebased upon the availability of the edible media and other food productingredients.

The system 100 a may additionally provide user interface controls for abakery application interface 133 through local control device 128, whichis connected to a customer display device 131 that is connected via thenetwork 118. In some implementations, the customer display device 131can be configured to display a GUI 157 for interacting with the hardwareand software components of system 100 a. The GUI 157 can, for example,include application screens, website content, software controls, andother Graphical User Interface content. In some implementations, the GUI157 includes administrative graphical elements associated with fillingfood product orders, interacting with consumers, obtaining imagelicenses, and maintaining bakery inventory. In some examples, the GUI157 is configured to provide food product order information to thebakery 112 associated with a customized food product designed by aconsumer. For example, the food product order information may includedata files for printing the edible media, decorating instructions forpreparing the food product according to a consumer's design, and thedate and time that the consumer has indicated for pickup or delivery.

The GUI 157 may also be configured to receive user inputs associatedwith maintaining product inventory at the bakery 112, which is used bythe system 100 a to determine possible dates and times that the foodproduct will be ready for pickup or delivery based on a lead time forthe food product. In some examples, the system 100 a can outputnotifications to the bakery 112 at GUI 157 to indicate when a particularingredient is running low or when there are very few or no verificationcodes for a particular type of edible media. In some embodiments, theGUI 157 may provide an interface for the bakery 112 to order ingredientsor edible media verification codes from one or more third-party vendors115 in response to receiving a low inventory notification. In someexamples where the local control device 128 is configured toautomatically initiate an inventory order at the third-party vendors 115when the inventory for a particular item is less than a predeterminedthreshold, the GUI 157 may be configured to output an automaticnotification to the GUI 157 to alert the bakery 112 that an itempurchase has been executed.

In some implementations, the GUI 157 is also configured to cause thelocal control device 128 to initiate printing of one or more editedimages received from the consumer onto the selected edible medium 102 atthe printer 134. The GUI 157 can also be configured to switch betweenmultiple software applications, including a software web browser andnon-web browser software. In some configurations, the GUI 157 isconfigured to retrieve non-licensed images. The GUI 157 can be presentedwithin a software web browser. In certain implementations, the bakery112 may print licensed digital images within a print environmentprovided internally by a web browser used to navigate a website with atleast one image database. In other embodiments, bakery 112 may printlicensed digital images in an external printing environment providedseparately from the software web browser.

Image Sources

The system 100 a, in some implementations, includes one or more deviceswhich can be communicably coupled to system 100 a as image sources 104.In this example, a variety of image sources 104 can be connected to thecentral control device 132 via the network 118. One such image source104 is the scanner 121. The scanner 121 can be a flatbed scanner, or anyother type of scanner such as a drum scanner or a through feed scanner.The scanner 121 allows an image to be rendered from personalphotographs, drawings, books, magazines, etc. In some embodiments, theimage sources 104 may include a 3D scanning device resulting in one ormore digital image files containing a 3D representation of an object. Incertain embodiments, system 100 a can evaluate acquired images forcopyright indicators. In an example the copyright indicators includecopyright and trademarks for figurines of fictional characters,celebrities, emblems, logos, mascots, and the like. Based on thedetection of copyright indicators, the user (e.g., bakery employee) maybe alerted to potential copyright limitations, or usage of the acquiredimage may be automatically denied.

Other image sources 104 include the digital camera 106, video device110, mobile device 116, video recorder 110, flash drive, and CD-ROM ORDVD. In certain embodiments, the image source 104 can be a personalelectronic device such as a camera phone or PDA. In operation, when aparticular image source is connected to a consumer computing device 122,a consumer can retrieve images from the connected image source to use inthe system 100 a for designing and producing customized food productswith edible media 102.

Images retrieved from image sources are uploaded to system 100 a andstored. For example, scanned images retrieved from scanner 121 areuploaded into system 100 a, stored by the central control device 132 atdata repository 129 as image data 141 and provided for use in the system100 a. The stored image data 141 can be retrieved by consumers and/orbakery employees for editing, printing, and so on.

The system 100 a, in some implementations, includes one or more videodevices 110, which may include any device that is capable of capturingand communicating a digital video signal. In certain embodiments, thevideo device 110 is a web camera. The video device 110 can be connectedto the central control device 132 via the network 118. In otherexamples, the video device 110 is connected to central control device132 through the consumer computing device 122. In some implementations,the consumer uses the video device 110 to transmit a digital videosignal to the central control device 132 via the network 118. In certainembodiments, a single frame can be extracted from the digital videosignal for printing at the GUI 127 of the consumer computing device 122.In other embodiments, a single image for printing can be generated basedon a montage of image frames extracted from the digital video signal. Incertain embodiments, the video device 110 is a personal electronicdevice such as a camera phone or PDA. The video device 110 is generallyconnected to the consumer computing device 122 and/or central controldevice 132 by a wireless means such as Wi-Fi, Bluetooth, near-fieldcommunication, or wireline means such as USB or similar connectors.

Central Control Device

The central control device 132, in some implementations, is connectedvia the network 118 to each of the other entities of the system 100 a(e.g., consumer computing devices 122, image sources 104, local controldevice 128, and third-party vendors 115). The central control device 132may include a software web server which allows the consumer computingdevices 122 and local control device 128 to communicate with a websiteon the central control device 132. In some implementations, the webserver can be any web server capable of communicating using standardnetwork protocols compatible with consumer computing devices 122 andlocal control device 128 using a variety of Internet connection typesand operating systems. The web server may run on a variety of operatingplatforms, for example Windows, Linux, MAC OS, or UNIX.

In some examples, the website (not shown) hosted on the central controldevice 132 can include a number of software engines (FIG. 2). Thesoftware engines may include, but are not limited to, image libraryengines, user account engines, edible media engines, photograph editingengines, consumer location recognition engines, training engines, printengines, licensing restriction engines, social networking engines,security engines, and/or messaging engines. The described softwareengines can be selectively combined to form a multifunctional softwareengine or split into multiple software engines. In some examples, eachsoftware engine is configured to support interactions between at leastone of the consumer computing devices 122 and local control device 128and the system 100 a at GUIs 127, 129 that are associated with designingand creating a customized food product. For example, the central controldevice 132 may include one or more software engines that providefunctionality associated with start-to-finish food product design by theconsumer.

The central control device 132, in some examples, may also includesoftware engines associated with providing administrativefunctionalities to the local control device 128 at the bakery 112associated with managing inventory and accessing consumer orderinformation. The central control device 132 may also include softwareengines that support interaction between the consumer computing devices122 and the local control device 128, such a messaging engine thatallows the bakery 112 to notify consumers when a food product order isready for pickup. In some implementations, the central control device132 is configured to control dissemination of notifications to thesystem entities responsive to actions taken by other system entities.For example, the central control device 132 may issue notifications tothe local control device 128 at the bakery 112 when a particularinventory item is running low. In some implementations, the centralcontrol device 132 may automatically initiate orders from one or more ofthe third-party vendors 115 when an identified inventory item reachesbelow a predetermined threshold. The central control device 132 may alsotransmit notifications to a consumer when a respective food productorder is ready for pickup.

In some examples, the central control device 132 can manage and controlinteractions between each of the entities of the system 100 a. Forexample, customized food product order information provided by theconsumer at GUI 127 and transmitted to the central control device 132and converted into decorating instructions that are forwarded to thelocal control device 128. Additionally, photos may be transmitted to thecentral control device 132 and stored as image data 141 in datarepository 129 for use by an authorized consumer at GUI 127 for aconsumer computing device 122.

Consumers at the consumer computing devices 122 and bakery personnel atthe customer display device 131 (via local control device 128) canaccess respective websites and accompanying software engines on thecentral control device 132 via the network 118, for example. Theconsumers at the consumer computing devices 122, in someimplementations, can search images, purchase images, edit images, printimages, order 2D and 3D edible media, design a customized food product,view training content, and access social networking features andaugmented reality content stored on the central control device 132. Atcustomer display device 131, bakery personnel can manage and purchaseimage licenses via local control device 128, view and manage inventorystatus for bakery 112, view order information for incoming customizedfood product orders, and transmit notifications to consumers associatedwith status of orders. Example software engines are discussed below inreference to FIG. 2.

The central control device 132 may include media servers, for example, aFLASH multimedia server, and the local control device 128 and consumercomputing devices 122 may include corresponding media players, forexample, a FLASH player. FLASH players may be implemented either as aplug-in to the software web browser, or as a stand-alone application.

Data Repository

In some implementations, the central control device 132 controlsinteraction between system entities (e.g., consumer computing devices122, image sources 104, local control device 128, and third-partyvendors 115) and data repository 129.

One type of data stored in the data repository 129, in someimplementations, is image data 141, which includes licensed digitalimages for decorating edible media by authorized users, which caninclude bakery personnel and/or consumers. The licensed digital imagesare protected from unauthorized usage and unauthorized user access. Thecentral control device 132, in some examples, provides a trackingmechanism to authorize or de-authorize usage of licensed digital images.For example, the central control device 132 can authorize the use ofparticular stored licensed digital images according to user credentials.The user credentials can be stored as consumer account data 147 forconsumers and bakery data 149 a for bakery personnel in the datarepository 129, or externally. The user credentials, in some aspects,typically include payment information, location information, and systemusage data. The central control device 132, in some embodiments,verifies whether specific users (e.g., bakery personnel or consumers)should be provided access to particular licensed images based on theuser credentials. In some implementations, the image data 141 may alsoinclude images that have been uploaded by consumers from one or more ofthe image sources 104. Each of the uploaded images may be associatedwith a particular consumer account so that only the consumer who hasuploaded the image (or someone authorized by the consumer) may accessand use the image during design of an edible media project

Project data 143 for each of the registered consumers can also be storedin the data repository 129. In some embodiments, project data 143 caninclude data associated with previously-designed or in-progress foodproduct designs. For example, a consumer may wish to order a birthdaycake for different co-workers over the course of a year and can accessthe project data associated with a previously designed birthday cake,which can then be altered to meet the specifications for a differentbirthday or event. In some embodiments, the system 100 a may transmitnotifications to consumers to remind consumers that they have anupcoming birthday or event that they ordered a food product for inprevious years so that the consumer can have an opportunity to designanother custom food product for the same event in a subsequent year.Additionally, consumers may save an unfinished project for a foodproduct and may access the unfinished project during a subsequent foodproduct design session.

The data repository 129, in some implementations, can also store bakerydata 149 a for each bakery that is registered to offer food productdesign capabilities (e.g., printed edible media design capabilities) toconsumers through the system 100 a. The bakery data 149 a may includeuser credentials for each registered bakery 112, location information,licensing information indicating which licensed images a bakery 112 isauthorized to print, and product information indicating the types offood products offered at each bakery 112. In some implementations, thebakery data 149 a may also include a library of application programminginterfaces (APIs) for bakery administration interfaces that arecustomized to preferences of each bakery 112 using the system 100. Forexample, a bakery 112 may receive customized food product orders througha general website associated with the system 100 but may have productpreparation and workflow processes that are unique to the bakery 112.The customized API for the bakery 112 can present the order informationand decorating instructions for customized food products in a formatthat is tailored to the processes of the bakery 112. The APIs for eachbakery 112, in some embodiments, provide the flexibility to adapt tochanges in preferences at each respective bakery 112 interacting withthe system 100 without affecting the interfaces of other bakeries 112with the system 100. For example, as shown in FIG. 6O, text and photoediting UI screen 601 is presented within a customized API 615 for aspecific bakery.

The data repository may also store inventory data 145 for each bakery112 registered with the system 100 a that includes a number of productcodes for each purchased type of 2D edible media, amounts of 3D ediblemedia printing materials, edible ink quantities, remaining amounts ofconsumable decorating products such as cake toppers and prepackageddecorating sets, and purchase dates and volumes of each type ofingredient or decorating product maintained in the bakery 112. Thecentral control device 132, in some implementations, may access theinventory data 145 for a particular bakery 112 when determining whetheradditional edible media sheets, 3D edible media printing materials,edible ink, other ingredients, or decorating products are due to bepurchased.

The data repository, in some embodiments, may also store GUI templates151 that are used by the system 100 a to generate one or more GUIscreens that are presented on the consumer computing devices 122 at GUI127 or the customer display device 131 at GUI 157. In one example, theGUI templates 151 may include calendar templates, which the system 100 apopulates with possible food product pickup and delivery dates based onpreparation lead times that are presented to consumers at the GUI 127.In some examples, the system 100 a can dynamically adjust the datapresented within the calendar template based on the products associatedwith a consumer-generated food product design and the availability ofthose products at the selected bakery 112.

In some implementations, data repository 129 can also store marketingdata 153 that the system 100 a can use to generate targeted marketingadvertisements for individual consumers as well as different demographicgroups of consumers. The marketing data 153, in some examples, mayinclude numbers of each type of ordered customized food product that canbe broken down into individual component categories corresponding toselections made by consumers at user interface screens for designing acustomized food product (see FIGS. 6A-6R). For example, the marketingdata 153 can include numbers of cakes that have been ordered over aperiod of time that have a particular color or flavor of icing, fillingflavor, cake flavor, size and shape, type of 2D and/or 3D edible mediaproduct, celebration occasion, type of decoration or topper, and type ofprepackaged decorating set. For each of the individual componentcategories, the marketing data 153 may include demographic informationrelating to the types of people who order each type of individual cakecomponent (e.g., age, gender, geographical region, marital status,parental status). For example, the marketing data 153 may include anumber of Boston Red Sox cake toppers have been sold within the UnitedStates as well as within the New England region during baseball seasonand during any given year.

Similarly, in some examples, the marketing data 153 can also includedata analytics for products ordered by bakeries 112 from third-partyvendors 115 that can be used to generate targeted marketing materialsfor bakeries. In some embodiments, the third-party vendors 115, such asdecorating product vendors, can market 2D and 3D edible media, caketoppers, prepackaged decorating sets, or any other decorations that canbe used to decorate customized food products based on previous ordersmade by bakery 112 or other bakeries having similar demographiccharacteristics.

Local Control Device

The local control device 128, in an example, includes at least onecomputing device that is coupled to the central control device 132 viathe network 118. In some implementations, each bakery 112 registered toprovide customized food products to consumers through the system 100 aincludes a local control device 128 for interacting with the system 100a. The local control device 128, in some examples, providesadministrative interactions with the system 100 a to the bakeriesthrough the GUI 157 at the customer display device 131. For example, thelocal control device 128 can, responsive to receiving consumer orderinformation from the central control device 132, present the orderinformation within the GUI 157 so the bakery 112 can download and printany edited images on an identified edible medium. In some examples, thelocal control device 128 may control and manage image licenses that aremaintained by the bakery 112.

The local control device 128 can also present decorating instructionscorresponding to the consumer's customized food product design so thatthe bakery can prepare the food product according to the consumer'sspecifications. In some examples, the local control device 128 can alsopresent inventory information to the bakery 112 via the GUI 157, and,responsive to determining that the inventory for a particular product islow, may present a website for ordering additional products from thethird-party vendors 115 at the GUI 157. Additionally, the local controldevice 128 may transmit messages from the bakery to the consumerregarding pickup times or specific order details to the central controldevice 132, which in turn forwards the messages to the appropriateconsumer.

The local control device 128, in some examples, is configured to printthe purchased image onto the edible media 102 and/or print 3D ediblemedia via a wired or wireless connection to edible media printer 134,for example. In some examples, the local control device 128 includes asoftware web browser that allows the local control device 128 tocommunicate with the central control device 132 via network 118. In someimplementations, the local control device 128 is a web server capable ofcommunicating using standard Internet protocols.

In some embodiments, the local control device 128 is configured todetermine an optimal edible media printing order for the printer 134 atthe bakery 112. For example, a bakery may receive food product ordersfor multiple types of printed edible media and food products that havevaried preparation lead times. The local control device 128, in someimplementations, can determine a print queue order for multiple ediblemedia prints associated with multiple orders that maximizes throughputand efficiency. In instances where an edible media sheet includesmultiple edible substrates, the local control device 128 may adjust theorder of edible media prints such that the printer 134 prints onto eachof the edible media substrates in a single printing session. In otherexamples, the local control device 128 may process the edible mediaprints in a first-in, first-out order.

Printing Device

The system 100 a, in some implementations, includes printer 134 that isconfigured to receive and print images upon edible media 102 usingedible inks. In some examples, the printer 134 may include a feed paththrough which the edible media 102 is inserted and conveyed past one ormore printheads. The printhead technology can be any type of printheadtechnology which can be controlled by digital signals including, forexample, inkjet, thermal inkjet, piezo inkjet, continuous inkjet, valvejet, electrostatic inkjet, airbrush technology, and computerizednumerical control (CNC) machines.

In one example, the printer 134 can be a 3D printer configured to printedible materials and/or edible inks. In an aspect, the 3D printer may beconfigured to print with an edible material supplied in various colors.In another aspect the edible material can have a base coloring (e.g.white, off-white, etc.) and the 3D printer can be configured to printwith a variety of edible ink colors upon the edible material. FIGS.1B-1E show examples of a 3D edible media 160 on printable base media150.

FIG. 1I shows a perspective view of a printer 134′ having a printhead192 connected to a printer frame 190 and a stationary platform 180′according to an example. In certain embodiments, the printer 134 canhave one or more fixed and/or moveable printheads and/or a maneuverableplatform. FIG. 1J shows a drawing of a printer 134″ having a jointedmovable printhead 192 and a maneuverable platform 180″ according to anexample. The jointed movable printhead 192 can function similar to amulti-jointed CNC robotic arm. Similarly, the maneuverable platform 180″can function similar to a multi jointed CNC robotic arm. Themaneuverable platform can alternatively be a rotating and/or orbitinggimbal platen and/or platform configured to rotate the food productwhile the printhead is in operation. The maneuverable platform can havea set of securing mechanisms 182 configured to hold or grip the foodproduct or the base 170. In an aspect the printer can coordinate tiltingof the edible media and an angle of the printhead, with tracking a setof deposition coordinates to match a secondary treatment.

In an example the printer 134 can print edible materials and edible inkson a large food product having one or more separated levels, sides, andcontours such as a tiered cake. In an example, the maneuverable platformcan rotate a tiered cake while printing on a side of the tiered cake. Inanother example the printer 134 can print edible materials and edibleinks on a small food product such as a cake pop. The cake pop can beeasily rotated in multiple configurations as compared to the largertiered cake. In another example the printer 134 can print an entire cakepop with edible materials and edible inks, as well as non-ediblematerials. FIG. 1J shows an example of a cake pop being held in the setof securing mechanisms 182 while being created and/or decorated.

In an example, the printhead can be configured to extrude a first ediblematerial to support a second edible material. For example, referring toFIGS. 1F-1H a combination of two or more edible materials can be printedin a coordinated manner. FIG. 1F shows a location of a cross section 164of a 3D edible media 160, as shown in FIGS. 1G-1H. FIG. 1G shows thecross section 164 of a first edible material 160 a surrounded by asecond edible material 160 b according to an example. In some examples,the first edible material can have a stiffness, density, and/orconsistency to support the second edible material, which may not havebeen able to support itself. In an example, the first edible materialcan be a nougat material and the second edible material can be achocolate coating on the nougat material, where the combined nougatmaterial and chocolate coating material form a three-dimensional objectsuch as a candy bunny.

FIG. 1H shows the cross section 164 of a first edible material 160 a anda second edible material 160 b adhering to the first edible material 160a according to another example. Either the first edible material or thesecond edible material can have a surface feature or adhesive propertyto promote adhesion.

The printhead can have a set of one or more nozzles for extruding thetwo or more edible materials together according to an example. Thenozzles can extrude each edible material separately or simultaneously byhaving one nozzle embedded in another nozzle.

The printheads can include one or more of an imaging device such as acamera, or a sensor such as a 3D scanner, a force transducer, atemperature detector, and an infrared detector as well as any othersensor related to 3D printing. In an example the imaging device can beconfigured to index, scan or read an indicator on or the shape of thefood product to determine a location of the surface of the food productfor printing.

In another example, the imaging device or sensor can be configured tocreate a digital scan or data on a shape and appearance of a real objectsuch as a food product or printable base media 150, and to create adigital model based on the digital scan or sensor. The digital scan canbe used to filter and to suggest different images that can be printed bythe printer 134 at different locations on the food product.

In an aspect the 3D printer can include a contour tool or reductivemodeling tool (e.g., carver/cutter/suction), a painting tool (e.g.,watercolor effect, airbrush, etc.), a curing head, and a set ofmulti-color printheads. In an example, the contour tool can beconfigured to shape, to remove, to cut, and to carve the food product oredible materials into a different contour. In an example, the contourtool can carve a fondant or a cake to a different shape. In anotherexample, the contour tool can shape an ice cream cone or other dessertcup. In another example, heads may be interchangeable to providemultiple functionality.

In an example, the printhead can include an in-situ sensor and/or abiopsy probe configured to determine a mechanical or structural propertyof the food product such that the contour tool removes a portion of thefood product without creating unintended instability. In an example, thesitu sensor can be an acoustic or ultrasound sensor, a non-penetratingpressure sensor, or any other type of sensor. In an example, the biopsyprobe can include a penetrating pressure sensor.

The curing head can be a cooler and/or a heater. In an aspect the 3Dprinter can use edible materials, as well as inedible materials such asplastic and/or wax (e.g. to print candles). In an example, the curinghead can be configured to lead or to follow a second printhead and applycooling and/or heat. In an example, a first printhead can be configuredto extrude an edible material such as cake batter, followed by a secondprinthead supplying heat to the cake batter such that the cake batterrapidly broils or bakes.

In some embodiments, the printer 134 is configured to function withinand/or provide a temperature-controlled environment. For example, whenthe edible media is a form of ice cream, the temperature-controlledenvironment can be a freezer or a platform that is chilled. In anotherexample, the printer 134 can include a temperature treatment to apply tothe printed edible media. In a particular example, a liquid nitrogentreatment may be deployed by one or more liquid nitrogen applicators ofthe printer 134 to set chilled decorations such as ice creamembellishments. In another example, a dry ice treatment may be deployedfor other freezing as well as visual effects. In an example, thesecondary treatment can be a coating for the dry ice treatment to slow,delay, or pattern a fog emanating from the dry ice treatment.

In some embodiments, the printer 134 includes a setting treatment forsetting the edible media after decoration. For example, the printer 134may supply a setting treatment via one or more applicators as afunctional layer, such as a hardening or stiffness support layer topromote structural integrity of the 3D edible media. In another example,the printer 134 may supply an aesthetic treatment via one or moreapplicators, such as adding a sheen, a glitter, or a glossy appearance,that may or may not contribute a functional benefit to the finishedproduct. In particular examples, the printer 134 may be configured toapply one or more of a sugar, a starch, a wax, and a glazing agent tostabilize a decorated edible media.

In some printing systems, the edible inks described above are generallyfed from a cartridge reservoir. Such cartridge reservoirs may berefilled as need. In some embodiments, images are printed onto atransfer layer, which in turn is applied onto the edible media 102.

In another example, the printer 134 can be used to dimensionalize afrosting sheet by printing a three-dimensionally textured background orscene for a corresponding non-printed decoration (e.g., DecoSet®Decorations by DecoPac, Inc. of Anoka, Minn.). In a particular example,train tracks and landscaping (e.g., mountains, trees, grass, water,etc.) can be three-dimensionally printed upon edible media, and a toytrain may be placed upon the textured scene.

In some implementations, in addition to printing images onto ediblemedia, the printer 134 can include a laser cutter for cutting outfigures or shapes, scribing, embossing, or etching the 2D and/or 3Dedible media based on customization details provided by the consumer.For example, the printer 134 may cut a circular edible media substrateinto the shape of a cat for a cat themed birthday cake. In someexamples, the printer 134 can also be configured to cut out figures orshapes of non-edible media to be used as decorations on customized foodproducts. For example, the printer 134 may be configured to cut outplastic or acrylic material into a desired shape, such as the initialsof the cake recipient.

Edible Inks

The edible inks used in the system 100 are typically formulated fromfood grade colors and ingredients to enable high quality,near-photographic images to be printed onto the edible media 102. Theseinks are edible and have precise color-matching properties, butadditionally function in a manner similar to other commerciallyavailable inks in printers. Edible inks may include natural inksmanufactured from a food grade base.

In some implementations, the edible inks are specifically formulated foruse in a particular printer. The user selects to print the image usingdifferent color models, according to the requirements of the printer.Providing selectable color models improves the precision of the printedimage by enabling adherence to particular color matching systems. Theedible inks may be inks designed to be used for decorating numerousdifferent types of food products, including, for example, cookies,cakes, pizza, cupcakes, candy bars, edible tattoos, temporary tattoos,cereal boxes, waffles, and pancakes.

In an example the edible ink can be an edible printing materialconfigured for 3D printing. The edible ink used for 3D printing caninclude any number of the following: icing, SugarSoft® by DecoPac, Inc.of Anoka, Minn., chocolate, frozen dessert material such as sorbet,yogurt, or ice cream, candy material, Royal icing, fondant, gelatin, andedible materials capable of being deposited by an airbrush styleprinthead tool.

The edible inks, in some embodiments, are additionally formulated tofaithfully render images in accordance with the appropriate color model.Possible color models include, but are not limited to, the Cyan,Magenta, Yellow and Black (CMYK) color model, as well as the RGB, LAB,HSB, Pantone, Hexachrome, and other color models. In some embodiments,the edible inks are formulated to render images in accordance with theCMYK color model. Other examples of edible inks that provide faithfulmatching to the CMYK color model, as well as other color models, andthat function within the constraints of commercially available printingtechnologies may be used in the system 100. In some configurations, theinks used in system 100 include a combination of edible inks, naturalinks, synthetic inks, or other inks.

Edible Media

The system 100 includes edible media 102 on which images are printed.The edible media 102, in this example, includes at least one ediblelayer 136 and an edible coating 138. The edible medium may be a singlelayer of edible material. For example, the edible medium may be a singlelayer of sugar paper, sugar paste, starch paper, fondant, or some otheredible form. Examples of options for edible material include but are notlimited to standard media with sizes of ½, ¼, and ⅛ sheet, or precutmedia of sizes 8 inch round, 3 inch round, or 2 inch round, or ediblestrips.

One embodiment of the edible layer 136 of the edible media 102 includesa mixture of a sugar paste of varying thickness. The edible layer 136 istypically formulated for several key features. First, the edible layer136 is mixed to depict high-quality pictorial images from particularedible inks disclosed herein. Second, the edible layer 136 travelsthrough a printer (e.g., printer 134) without damaging the edible media102, the edible layer 136, or the printer. For example, the edible layer136 is mixed to ensure sufficient strength to be bent and manipulatedthrough the conveying path of the printer 134, withstand the heat of theprinting process, and still maintain suitable textural integrity as tonot jam in the printer mechanism of printer 134. Third, the edible layer136 is mixed to ensure there is no detraction from the taste of the foodproduct on which it is to be applied. Other variations of edible layersand edible media may be used as well.

In some implementations, the edible layer 136 is formulated for use indecorating pizza or deli type items. For example, the edible layer 136may be formulated as savory rather than sweet.

Other examples of edible layers 136 are described in U.S. Pat. No.5,017,394, assigned to the Lucks Company, and incorporated herein byreference. This type of edible layer 136 is formed from a flour and/orstarch base as opposed to the sugar base of a fondant. Another exampleof an edible layer 136 is disclosed in U.S. Pat. No. 5,334,404, issuedto Garcia et al. and incorporated herein by reference. Other types ofedible layers 136 can be used including, but not limited to rice paper,wafer paper, and other edible substrates on which an image may beprinted.

The edible coating 138 enables the edible media 102 to render a highquality pictorial image on the surface of the edible layer 136. Withoutthis coating 138, the inks tend to run or bead or form an imperfectimage. In one example, the coating 138 is a very thin layer of calciumcarbonate. This thin layer allows the inks to properly perform to rendera high-quality pictorial image. Other coatings may be used in system100.

In some embodiments, the edible media 102 may also include an optionalrelease sheet 140 having a silicon coating functioning as a backingmaterial, for example. In some implementations, the edible media 102 isa standard size or shape. Example sizes can include 8.5 inches by 11inches, 9-inch round, and 8-inch round. The size can be a precut size ora selectable size. In some configurations, frosting layers, ediblematerial and/or fondant layers can be malleable and/or stretchable tovarious sizes and shapes.

FIGS. 1B-1E show examples of 3D edible media 160 on a food product 150,where the 3D edible media 160 has a center of mass 162 and a contactarea 152 with the food product 150.

As shown in FIG. 1B, the center of mass 162′ of the 3D edible media 160on the food product 150 can be within the 3D edible media 160. As shownin FIG. 1C, the center of mass 162″ of the 3D edible media 160 on thefood product 150 can be outside of the 3D edible media 160. As shown inFIGS. 1D-1E, the center of mass 162′″ of the 3D edible media 160 on thefood product 150 can be unsupported by the contact area 152 and therebycan move or tip due to gravity. In an example, the 3D edible media 160can be made from a combination of edible materials such that the centerof mass 162 can be shifted.

As shown in FIG. 1D, the 3D edible media 160 can include a base 170 thatcan be configured to support and mechanically compensate for the centerof mass 162′″ in an example. As shown in FIG. 1E, the base 170 caninclude one or more attachment features 172 that can be configured tosupport, couple, and mechanically compensate for the center of mass162′″ according to an example. In one example, the base 170 andattachment features 172 can be made from one or more edible materials.In another example, the base 170 and attachment features 172 can be madefrom one or more non-edible materials. In another example the base 170and attachment features 172 can be made from a combination of one ormore edible materials and one or more non-edible materials.

In examples where the system 100 for designing and producing customizedfood products with edible media is configured for designing andproducing customized deli food product orders (see FIG. 1L), the ediblemedium may be made of a savory material, which may be applied to pizzacrust, cracker, tortilla, pita, bread, roll, or bun (e.g., hamburger,hot dog), cheese ball or slice, dip or sauce, or vegetable or fruitslice. In some examples, the savory edible media can include soy,potato, corn, sweet potato, plantain, or other starch-based flat,flexible printable media (e.g., tortilla, soy paper, etc.). The savoryedible media can also be legume-based flat, flexible printable media(e.g., black bean, pinto bean, chick pea), wheat, rice or othergrain-based printable flat, flexible printable media (e.g., tortilla,rice paper, etc.), dehydrated fruit-based printable surfaces (e.g.,fruit leather), savory frosting (e.g., cream cheese “fondant,” andsavory gels/gelatin-based media. Additionally, in some examples where acustomized image is etched onto an outer surface of a fruit or vegetable(e.g., melon, squash, pumpkin) the edible medium can be the entire outersurface of the respective food item. A customized image can also beetched into other types of deli products, such as pita, bread, rolls,buns, and cheese.

Third-Party Vendors

In some implementations, third-party vendors 115 may be optionallyincluded as part of the system 100 a for designing and producingcustomized food products with edible media 102 and may include a numberof computing devices and databases distributed across a widely-dispersednetwork that may be distributed across a large, international geographicarea. In some examples, the central control device 132 may initiateorders for 2D and 3D edible media, food product ingredients (e.g.,edible inks, food coloring such as airbrush colors or gel colors, quins,sprinkles, sugars, confections, etc.), cake toppers, cake overlays,prepackaged decorating sets that include a combination of toppers,decorations, overlays, and 2D or 3D edible media, and food productaccessories (e.g., candles for a birthday cake, cake bases, boxes,stands, rings, and decorative pics, etc.) based on receiving aninventory order submission from the local control device 128. In someimplementations, the third-party vendors can include commercial foodsuppliers and suppliers of cake toppers, decorations, edible media, andprepackaged cake decorating sets. In some implementations, the centralcontrol device 132 (via the local control device 128) presents one ormore web order forms for the third-party vendors 115 within the GUI 157at the customer display device 128, and bakery employees manuallyinitiate orders with the third-party vendors 115. Additionally, thecentral control device 132 can also transmit automatic notifications tothe local control device 128 to notify the bakery 112 that a particularinventory item is running low. In other examples, the central controldevice 128 and/or local control device 128 can automatically initiateorders with the third-party vendors 115 when an amount of a particularinventory item is less than a predetermined threshold through abusiness-to-business e-commerce website.

Kiosk

Turning to FIG. 1K, another example of a system 100 b for designing andcustomizing edible media 102 is illustrated. In addition to includingall of the elements of system 100 a shown in FIG. 1A, the system 100 bshown in FIG. 1K includes a kiosk 161 for consumers to input foodproduct orders. In some implementations, the kiosk 161 may be locatedwithin the bakery 112, such as in a common area of the bakery 112 whereconsumers browse for products or in a bakery section of a grocery store.In other examples, the kiosk 161 may be remotely located from the bakery112 such as in a shopping mall, convenience store, or other store thatis not co-located with the bakery 112. In some examples, the kiosk 161may transmit customized food product orders directly to the localcontrol device 128 for processing and fulfillment via the network 118.In other embodiments, the kiosk 161 may transmit the customized foodproduct orders to the central control device 132 for processing andtranslation into a set of decorating instructions, which are transmittedwith any applicable print data (e.g., data files for printing editedimages on edible media) to the local control device 128 at the bakery112.

In some examples, the kiosk 161 may include a display for presentingfood product customization user interface screens to consumers designingtheir customizable food product. The kiosk 161 may also include aprocessor and associated circuitry for processing customized foodproduct orders and interacting with other computing devices (e.g., localcontrol device 128 and central control device 132) of the system 100 b.In some embodiments, the customization user interface screens correspondto the user interface screens of GUI 127 presented at the consumercomputing device 122. In one example, the display includes touchscreenfunctionality such that a consumer can provide inputs to the userinterfaces directly via the touchscreen. For example, the display may bea tablet computing device.

In some implementations, the kiosk 161 can include circuitry configuredto host an access point for one or more consumer computing devices 163.For example, the kiosk may include circuitry for generating a shortrange wireless communication network 165, such as a Bluetooth wirelesscommunication network for connecting to one or more consumer computingdevices 161 so that consumers can interact with the kiosk 161 to designcustomizable food products at their own consumer computing devices 161,which allows greater numbers of consumers to interact with the system100 b simultaneously. In some implementations, the kiosk 161 may searchfor consumer computing devices 163 within communication range of thekiosk 161. When an in-range consumer computing device 163 is detected,the kiosk may transmit a connection query to the device 163 to determinewhether the consumer is interested in connecting the consumer computingdevice 163 to the kiosk 161 to design a customized food product. Inother examples, consumer operating devices 163 may manually search forand establish a communication link with the kiosk 161 via the network165. In some examples, when a consumer computing device 163 connects tothe kiosk 161 via the network 165, the kiosk 161 assumes a role asmaster in a master-slave relationship with the consumer computing device163. For example, upon connection to a consumer computing device 163,the kiosk 161 may cause presentation of one or more food productcustomization user interfaces screens at the device 165 such that thedevice 165 functions as an input/output device, and the kiosk 161presents the customization and editing options to the consumer computingdevice at the user interface screens and also receives and processesinputs that are provided by consumers at the user interface screens.

In other embodiments, instead of a Bluetooth wireless communicationnetwork, Ultra Wide Band (UWB) or ZigBee wireless communications may beused. The type of wireless communication technology that is used for theimplementations described herein can be based on various factors thatcan include battery life, data usage, security and/or line-of-sightrestrictions, and other concerns. In some embodiments, ZigBee orBluetooth wireless communications may be used in applications where linksecurity is prioritized. In other embodiments where frequencyinterference is a concern, Bluetooth or UWB communications may be usedsince both technologies use adaptive frequency hopping to avoid channelcollision. In embodiments where a total of frequency channels isprioritized, Bluetooth wireless communications may be used. In someexamples, the kiosk may include multiple access points that usedifferent short range wireless communication technologies.

In some implementations, the consumer computing device 163 may connectdirectly to a wireless communication network at bakery 112 via kiosk 161or independent of kiosk 161. In some examples, when connected to thebakery wireless communication network, the consumer computing device 163accesses a unique URL for the bakery 112 at which the consumer can viewand select customization options for a customized food product. Forexample, when a consumer connects to the bakery wireless communicationnetwork and opens a web browser on consumer computing device 163, theconsumer is automatically directed to the unique URL for the bakery 112to design a customized food product.

In some embodiments, a user can upload a photo to the system 100 c viaconsumer computing device 163 for customization at the kiosk 161. Forexample, as shown in FIG. 6P, the central control device 132 can providea user contact information user interface (UI) screen 617 to kiosk 161.At the UI screen 617, a consumer can provide a phone number 619 and/oremail address 621 that can be used to interact with the system 100 c andkiosk 161. For example, responsive to a consumer providing a phonenumber 619, the central control device 132 can cause a text message tobe transmitted to the consumer computing device 163, as shown in mobilemessaging interface 623 in FIG. 6Q. The mobile messaging interface 623can include a web URL 625 that allows a consumer to access a photoupload interface 627 (FIG. 6R) for uploading one or more photos to thesystem 100 c. In some examples, the photo upload interface 627 enablesthe consumer to select a photo 629 stored on the consumer computingdevice 163 for upload to the system 100 c and provide a message 629 tothe bakery 112 with customized information about the photo. In someexamples, upon uploading a selected photo to the system 100 c, theconsumer can use UI screens at the kiosk 161 to access the uploadedphoto, add the photo to a customized food product, and edit the photowithin food product customization UI screens. In one example, theinteractions between the central control device 132, kiosk 161, andconsumer computing device 163 for providing images from the consumercomputing device 163 for use at the kiosk 161 can be controlled by acloud-based messaging platform.

Customized Deli Food Products

Turning to FIG. 1L, another example of a system 100 c for designing andproducing customized food products with edible media is illustrated.Consumers, in some implementations, interact with the system 100 cthrough a web-based application to design customized deli food productsfrom start to finish without, in some embodiments, needing to have anyadditional communication or interaction with the deli. In some examples,the customized deli food products can include deli trays (e.g., cheeseand cracker trays, fruit and vegetable, chips and dip), pizza,sandwiches, hamburgers, and hot dogs. For example, consumers can selectimages and design customized messages that can be printed onto savoryedible media or etched into the edible media with a laser printer. Inone example, a laser printer can etch a customized edible media designinto pieces of bread that are used to make a sandwich. In anotherexample, a laser printer can be used to etch customized designs intocheese balls for a cheese and cracker plate. Additionally, customizeddeli food products can also include fruits or vegetables (e.g., melons,squash) that have customized etching designs applied to an outer skin orsurface with laser etchers/printers that are communicatively coupled tothe system (e.g., printers 134). In a further example, custom imagesand/or messages can be printed on the surface of a dip or sauce, such ashummus, salad dressing, or spreadable chocolate.

The system 100 c, in some implementations, includes all of the samesystem components as the systems 100 a,b for designing and producingcustomized food products with edible media 102 except that the localcontrol device 128 is located at a deli 155 instead of a bakery 112, anddata repository 129 stores deli data 149 b rather than bakery data 149a. Like the bakery data 149 a, the deli data 149 b may include usercredentials for each registered deli 155, location information,licensing information indicating which licensed images a deli 155 isauthorized to print, and product information indicating the types offood products offered at each deli 155. In some implementations, thedeli data 149 b may also include a library of APIs for deliadministration interfaces that are customized to preferences of eachdeli 155 using the system 100. Kiosk 161, in some examples, mayoptionally be included as part of the system 100 c. Throughout thedisclosure, references to bakery 112 and bakery personnel areinterchangeable with deli 155 and deli personnel. For example, consumerscan design customized bakery or deli products that include edible mediathrough interactions with system GUIs, and any system functionalitydescribed with respect to bakery 112 can also apply to deli 155, and anyfunctionality described with respect to deli 155 an also apply to bakery112.

The deli 155, in some implementations, can include multiple printers 134connected to local control device 128 for printing onto edible media102. In some embodiments, each of the printers 134 at the deli 155 canbe configured to print onto specific types of edible media (e.g., oneprinter is configured to print onto bread and pizza dough, anotherprinter is configured to print onto cheese slices, and a third printeris configured to deposit decoration on a sauce or dip). In someexamples, print data for customized images created by consumers aretransmitted to a specific printer 134 at the deli based on foodallergies associated with a customized food product order. The system100 c, in some implementations, can present GUI 171 to a consumercomputing device 122 that allows the consumer to indicate any foodallergies associated with the order. For example, if an order includesan indication of a peanut allergy, the central control device 132 and/orlocal control device 128 may transmit the print data for the order to aprinter 134 in a “peanut free” zone of the deli. The local controldevices 128 for systems 100 a,b can also be configured to transmit printdata to different edible media printers at a bakery 112 based on foodallergies associated with an incoming order.

In some embodiments, the GUI 171 for designing and producing customizeddeli products allows consumers to design a layout of food products on adeli tray (e.g., cheese and cracker trays, fruit and vegetable trays,chips and dip trays) and a relative placement of printed edible media102 on the tray. For example, the consumer can identify sections of adeli tray within the GUI 127 that will hold each type of vegetable anddip as well as a location of the printed edible medium. In one example,the printed edible medium may cover a section of the tray that holds adipping sauce. The consumer can also indicate at the GUI 127 where toplace other types of decorations and toppers on the deli tray.

Additionally, the GUI 171 for designing and producing customized deliproducts can include all of the features of the GUI 127 described abovefor designing and producing customized bakery products in systems 100a,b (FIGS. 1A, 1K). For example, consumers can interact with GUI 171 toupload and edit images for edible media, select licensed and/orunlicensed images for printing onto edible media, select a type ofedible media, select and design 3D edible media, select decorating setsthat include a combination of background overlays and decorations,select customized options for the deli products (e.g., sandwich options,deli tray options) and identify placement of decorative elements andedible media on the customized deli food product. In one example, athree dimensional sweet or savory decoration may be printed on anarrangement of crackers. In another example, a background and/or framingarrangement can be deposited in two dimensional or three dimensionalmaterial upon a platter. The background and/or framing arrangement maybe deposited in edible and/or non-edible material, such as an inedibleplatform structure (e.g., such as a pick or spike to maintain adecoration in a selected position) topped with an edible decoration.

In some implementations, the GUI 171 is configured to allows consumersto select a preferred deli 155 for preparing the customized foodproduct. In one example, the GUI 171 provides an interactive calendarfor viewing available pickup dates and times for the food product basedon the availability of the selected 2D and/or 3D edible media and otheringredients associated with the decorating instructions (for example, 3Dobjects, food coloring, edible ink) for the selected deli. In someexamples, the central control device 132 of the system 110 c isconfigured to dynamically adjust the available pickup date/timedisplayed at the GUI 171 of the consumer computing device based upon theavailability of the edible media and other food product ingredients. Insome examples, the central control device 132 can also adjust thepick-up time based on pending orders in a preparation queue for aparticular bakery 112/deli 155 and an optimized printing order foredible media associated with the pending orders.

Additionally, the GUI 157 for interactions of deli personnel with thesystem 100 c for designing and producing customized deli food productsincludes all of the features of the GUI 157 for interactions of bakerypersonnel with the systems 100 a,b. In some implementations, the GUI 157includes administrative graphical elements associated with filling foodproduct orders, interacting with consumers, obtaining image licenses,and maintaining deli inventory. In some examples, the GUI 157 isconfigured to provide food product order information to the deli 155associated with a customized deli food product designed by a consumer.For example, the food product order information may include data filesfor printing the edible media, decorating and preparation instructionsfor preparing the food product according to a consumer's design, and thedate and time that the consumer has indicated for pickup or delivery.

The GUI 157 may also be configured to receive user inputs associatedwith maintaining product inventory at the deli 155, which is used by thesystem 100 c to determine possible dates and times that the food productwill be ready for pickup or delivery based on a lead time for the foodproduct. In some examples, the system 100 c can output notifications tothe deli 155 at GUI 157 to indicate when a particular ingredient isrunning low or when there are very few or no verification codes for aparticular type of edible media. In some examples where the localcontrol device 128 is configured to automatically initiate an inventoryorder at the third-party vendors 115 when the inventory for a particularitem is less than a predetermined threshold, the GUI 157 may beconfigured to output an automatic notification to the GUI 157 to alertthe bakery 112 that an item purchase has been executed. In someembodiments, in determining the possible dates and times, the system 100c includes algorithms and project data 143 related to staged preparationof particular arrangements including, in some examples, times to depositand set a number of printed elements of the food product order. Inillustration, the system 100 c may identify multiple stages ofpreparation such as a deposition of background and/or framing designstage, printing and/or etching of designs upon one or more food itemsstage(s), and a manual layout of food items upon the tray or otherdesign stage. Time estimates associated with each stage, andavailability of equipment for performing the steps of each stage, may becomputed to estimate availability of the finalized product.

In addition to the third-party vendors 115 for the systems 100 a,b, thesystem 100 c for designing and customizing deli food products, in someembodiments, can communicate with third-party vendors 115 that selldeli-related food items (e.g., meat, cheese, produce, and bread productdistributors) and consumable material products (e.g., disposable delitrays). The system 100 c, in some implementations, maintains a status ofall inventory items for the deli 155 and automatically initiates ordersto transmits notifications to deli personnel when a particular inventoryitem is less than a predetermined threshold.

System Software Engines

FIG. 2 illustrates an example computing system 200 including softwareengines used in a system for designing and producing customized foodproducts with edible media. The system 200 can, for example, beanalogous to central control device 132 or a combination of the centralcontrol device 132 and local control device 128 (FIGS. 1A, 1K, 1L). Auser of the system 200 (e.g., a consumer at consumer computing device122 or bakery/deli personnel at customer display device 131), in someimplementations, accesses a website on the central control device 132 togain access to one or more software engines 210-252. In someimplementations, the system 200 includes a first set of software engines202 that provide the customization and design functionality to theconsumer computing device 122 via the GUI 127, 171 and processing thefood product customization inputs received at the GUI 127, 171. In someexamples, the second set of software engines 204 may be hosted entirelyby the central control device 132 or at a combination of both thecentral control device 132 and consumer computing device 122. The system200, in some examples, also includes a second set of software engines204 that provide administrative functions of the system 200 to thebakery 112 and/or deli 155 via the local control device 128. In someexamples, the second set of software engines 204 may be hosted entirelyby the central control device 132, entirely by the local control device128, or at a combination of both control devices 132, 128. The system200 may also include a third set of software engines 206 that providefunctionality for interactions between consumer computing devices 122and the local control device 128 at the bakery 112 and/or deli 155. Thesystem 200 may also include a fourth set of software engines 208 thatprovide functionality for the kiosk 161 as well as any other systemoperations.

For example, the first set of software engines 202 may include aconsumer-facing design engine 210, an image library engine 212, an imageediting engine 214, an edible media engine 216, a user account engine218, a license engine 220, a location engine 222, a training engine 224,an ordering engine 226, an authentication engine 228, an instructiongeneration engine 230, an application management engine 234, and amarketing automation engine 235. The described software engines can beselectively combined to form a multifunctional software engine or splitinto multiple software engines.

Consumer-facing design engine 210, in some implementations, is asoftware engine that provides consumers the ability to design customizedfood products from start to finish. In some examples, theconsumer-facing design engine 210 manages the interactions between othercustomization engines (e.g., image library engine 212, image editingengine 214, and edible media engine 216). Additionally, theconsumer-facing design engine 210 causes presentation of user interfacescreens (GUIs 127, 171) at the consumer computing device 122 that allowthe consumer to provide inputs for cake flavor, filling flavor, icingcolor and design, upper and lower icing border colors, edible medialayout, cake theme, and any other type of selection related to a cake'sdecorative design (See FIGS. 6A-6R and 7A-7D). For customized deli foodproducts, the customized user interface screens also allow consumers toselect customized options for the deli products (e.g., sandwich options,deli tray options) and identify placement of decorative elements andedible media on the customized deli food product. In someimplementations, the consumer-facing design engine 210 only presentsdesign selections that are available at the bakery 112/deli 155 selectedby the consumer. The consumer-facing design engine 210 can, in someexamples, present the unavailable design selections at the userinterface screen with an indication that a particular design selectionis unavailable at the selected bakery 112/deli 155 (for example, throughan adjustment in hue of the unavailable selection or with the words“unavailable at the selected bakery” below the selection). If theconsumer wishes to select the unavailable selection, the consumer canchoose another bakery that offers the desired design selection.

With each design selection made at the user interface screens, theconsumer-facing design engine 210 can calculate an updated price for theorder in-real time. In some implementations, based on inventoryinformation at the selected bakery, the consumer-facing design engine210 can be configured to recalculate the preparation lead time for thecustomized food product in real-time responsive to each design selectionmade by the consumer.

The image library engine 212, in some implementations, is a softwareengine including digital images that can be printed onto an ediblemedia. The image library engine 212 includes both images available forpurchase and free images. The images may be licensed or unlicensedimages, and may include clip art, illustrations, photographs, text,three-dimensional images or other 2D and/or 3D file content. The imagelibrary engine 212 generally contains different formats of the sameimage each of which are configured for printers that use differing colormodels.

In some examples, the image library engine 212 allows users (e.g.,consumers or bakery/deli personnel) to browse or search through theimages using keyword criteria such as “Sports” or “Princess” or“Birthday.” The image library engine 212 may be updated with new imagesand new image formats. In certain embodiments, image library engine 212may be updated with an image acquired through a remote image source,such as a USB WebCam or a mobile device. In another illustrativeembodiment, image library engine 212 may be updated by a reference toWeb content, such as a photograph posted on a social media network. Inanother implementation, image library engine 212 may be updated based onchanges in agreements with image suppliers, and/or alterations in filessupported by the system 100.

In some embodiments, the image library engine 212 interacts with thelicense engine 220 and the location engine 222 to allow or restrictusers (e.g., consumers or bakery/deli personnel) when finding and/orpurchasing particular images. In some implementations, consumers areable to search for and select images that have been purchased by aselected bakery 112/deli 155. In other examples, individual consumerscan search for and purchase licenses to their own images for their ownuse in designing and producing customized food products. For example,the license engine 220 may restrict access to a user based on a numberof factors. One example factor may include barring image purchases basedon a geographic location and/or an authorized list for the user. In thisexample, when a user selects to view images available from the imagelibrary engine 212, the location engine 222 can automatically identifythe geographic location of the user. The user's geographic location canthen be used by the license engine 220 to identify whether any of theimages in the image library engine 212 are restricted from being sold inthe user's location. If a restriction is found, the license engine 220sends to the image library engine 212 information on which images areunavailable to the user. The image library engine 212 removes therestricted or unavailable images from the image library made availableto the user. In certain embodiments, restriction of images based on theuser's geographic location can be in addition to or in substitute for anauthorized list of images containing available images for the user.

The image library engine 212 also interacts with the user account engine218 to allow a secondary user to only search and purchase images thathave been authorized by a principal user. In some implementations, theprincipal user, such as a bakery or deli employee, searches through theimage library engine 212 and purchases and/or identifies images that canbe selected by secondary users designing a customized food product forpick-up at the respective bakery 112/deli 155. The principal user, insome examples, can designate different images for secondary users(consumers) in different geographic locations. When a secondary useraccesses the website and selects to search the images in the imagelibrary engine 212, the secondary user is only shown the imagesavailable at the secondary user's geographic location, and/or on thesecondary user's authorized list, which is made of images previouslyauthorized by the principal user.

The image library engine 212 interacts with the print engine 246 toensure that the version of the image that is compatible with the colormodel of the printer 134 is sent to the printer at bakery 134. When abakery/deli employee selects to print an image, the print engine 246 or3D print engine 247 sends to the image library engine 212 the colormodel of the printer 134 at bakery 112/deli 155. The image libraryengine 212 sends to the printer 134 the correct format of the image. Incertain embodiments, the print engine 246 or 3D print engine 247 promptsor allows bakery/deli personnel to identify the printer 134 connected tolocal control device 128. In other illustrative embodiments, the printengine 246 or 3D print engine 247 auto detects the identity of printer134.

In some implementations, the image library engine 212 also interactswith the edible media engine 216 to enable the consumer to identifyimages suitable for the particular edible media selected for decoration.The consumer enters into the edible media engine 216 the specific typeof edible media being decorated. The edible media engine 216 containscharacteristics of the edible media and sends to the image libraryengine 212 specific criteria for compatible images, such as image size.The image library engine 212 removes the images which are not compatiblewith the edible media the consumer selected.

The image editing engine 214, in some embodiment, is a software enginethat allows consumers to edit selected images. Example editing functionsmay include cropping, moving, rotating, re-touching, brightening,darkening, and adding text to images, as well as other image editingoperations. The image editing engine 214 interacts with the licenseengine 220 to prevent consumers from editing images on which there areediting restrictions imposed by a license. The license engine 220informs the image editing engine 214 if there are any restrictions onediting the selected image, and if so, how. The image editing engine 214then prevents the consumer from editing any images in violation of alicense.

The edible media engine 216, in some examples, is a software engine thatincludes a list of 2D and 3D edible media materials available to be usedin the system 100 and which are available for purchase by the bakery112/deli 155. Bakery/deli personnel, in some implementations, can searchor browse through the edible media engine 216 using various keywordcriteria, such as “cupcakes” or “cake.” The edible media engine 216 mayalso contain information about the cost and availability of ediblemedia. Furthermore, the edible media engine 216 also may contain adatabase of unique codes that are associated with particular ediblemedia. The unique codes may function as part numbers, printing data,cost data, retrieval data, or other data. The edible media engine 216,in some examples, interacts with the user account engine 218 to allowthe bakery/deli employee to purchase edible media via a third-partyvendor 115. Once the bakery/deli employee selects an edible media forpurchase, the user account engine 218 processes the financialtransaction. In some implementations, if a licensed image is selected,the user account engine 218 may require the bakery/deli employee tocheckout before proceeding to print the image on the edible media.

In some implementations, the edible media engine 216 interacts with theimage library engine 212 to allow the bakery/deli employee to identifyimages that are compatible with particular 2D or 3D edible media. Theedible media engine 216 contains information about edible mediacompatible with the system 100. The bakery 112 and/or deli 155, in someimplementations, chooses a specific type of edible media and the ediblemedia engine 216 sends information about this edible media to the imagelibrary engine 212. The image library engine 212 then isolates specificimages that are compatible with the particular type of edible media.

The edible media engine 216 includes at least one data repository (e.g.,inventory data 145 of data repository 129 in FIG. 1) of unique codesthat are associated with particular edible media. The edible mediaengine 216 tracks whether or not a code has been used to authorize aprint. In some examples, the edible media engine 216 interacts with theprint engine 246 and 3D print engine 247 to verify that the bakery 112is using authorized edible media using the codes. The print engine 246or 3D print engine 247 notifies the edible media engine 216 uponreceiving a purchase request, which prompts the bakery 112/deli 155 toenter the code from the edible media. The edible media engine 216verifies that the code is valid and that the code has not beenpreviously used. If the code is valid, then the print engine 246 or 3Dprint engine 247 proceeds with the print of the image. If the code isnot valid, then the print engine 246 or 3D print engine 247 notifies thebakery 112/deli 155 of the invalidity without printing the image. Insome implementations, the edible media engine 216 can be implemented aspart of inventory management engine 236. In some examples, when a numberof unique codes associated with a particular type of edible media isless than a predetermined threshold, the edible media engine 216 cantransmit edible media ordering information to the inventory managementengine 236 so that new edible media and associated codes can be orderedfrom an edible media vendor.

In some embodiments, the user account engine 218 is a software enginethat maintains profiles of individual users in user accounts. In someexamples, the user accounts may include accounts for both consumers andbakery/deli personnel at bakery 112/deli 155, which can be stored indata repository 129 as account data 147 and bakery/deli data 149,respectively. The user account engine 218 can process financialtransactions, for example, for consumers to purchase customized foodproducts and also provides a tracking mechanism for customized foodproducts that have been ordered by consumers. In some examples, the useraccount engine 218 can store purchase and order histories for consumersincluding selected images, designs, text content printed, notificationsconfigured, and edible media purchased. The user account engine 218 canalso store consumer profiles, address data, financial data, imagerestrictions as account data 147, and previous order information foreach consumer, in data repository 129.

The user account engine 218, in some examples, also manages accounts forbakery/deli personnel, which can include information pertaining to anumber of personnel who have access to the system 100, address data,financial data, authorized edible media codes, purchased images,information for consumers that have ordered products from eachrespective bakery, and approved image licenses for customized foodproducts. The bakery account information can be stored in the datarepository 129 as bakery/deli data 149. In some embodiments, the useraccount engine 218 maintains a list of usernames and passwords forbakery/deli personnel that provide or limit access to particular useraccounts.

In some configurations, the user account engine 218 can provide anoption for bakery/deli personnel and/or consumers to purchase creditsthat can be used to purchase images. The credits, in some embodiments,can be incremented when purchased and decremented when the bakery112/deli 155 purchases images using system 100. For example, if a bakery112/deli 155 chooses to download and print a digital image, the useraccount engine 218 can decrement the bakery's or deli's credits therebyproviding payment and print the requested images onto a requested ediblemedium.

Licensed digital images, in some examples, can be charged on a per usebasis. Thus, if the bakery 112 or deli 155 prints the same licenseddigital image on six cupcakes, the bakery 112 may be charged six creditsfor using the licensed digital image six times. In some implementations,the system 100 can allow printing of a licensed image multiple times onone sheet of edible media, for example, at the cost of one usage (e.g.,one credit). The system 100 may allow a variable relationship between animage and the number of credits required to use the image. In the eventthat the bakery 112 or deli 155 is short on credits, the bakery/delipersonnel may be prompted to purchase additional credits by using acredit card, for example. If, however, the bakery 112 or deli 155 wishesto print non-licensed digital images, no credit charge will betransacted. Rather, the bakery 112 simply purchases any materialsutilized.

In some embodiments, a selected licensed digital image can beinstantaneously purchased from the central control device 132 bybakery/deli personnel (via local control device 128), for example, uponreceiving (i) entered payment information and (ii) a request forpurchase of the selected licensed digital image. The payment informationcan, for example, allow access to an e-commerce system (e.g., withinsystem 100) for purchasing licensed digital images using decrementablecredits for printing licensed digital images. The e-commerce system canbe adjustable for multiple currencies such as the U.S. Dollar, thePound, and the Euro, just to name a few examples.

In some configurations, bakeries or delis can pre-purchase credits thatenable a print function to be selectable within the GUI 157, forexample. The pre-purchased credits allow for bakeries/delis to easilyaccess licensed content as part of a custom design and print the designin an accelerated fashion. For example, if the bakery 112/deli 155pre-purchased credits, the bakery 112/deli 155 may have been asked tosign a licensing/usage agreement at the time of purchasing the credits.Thus, when the bakery 112/deli 155 performs a transaction with suchcredits, additional forms and/or steps are not required of the bakery112/deli 155 to print the image on edible media. In someimplementations, the payment information includes credit card datarather than previously purchased credits. In some embodiments, thepayment information includes credit card data presented for purchasingdecrementable credits.

In some embodiments, the user account engine 218 interacts with theimage library engine 212 to allow the bakery 112 to purchase an imagefrom the image library engine 212. Once the bakery/deli employee selectsthe desired image and chooses to complete the purchase, the user accountengine 218 completes the purchase. For example, the user account engine218 can verify whether the bakery 112 or deli 155 has any availablecredits. If the bakery 112/deli 155 does have available credits, thenone or more credits are debited from the bakery's credits and the useraccount engine 218 authorizes the use of the image. If the bakery112/deli 155 does not already have available credits, the user accountengine 218 may prompt the bakery/deli personnel for credit cardinformation or bank account information for direct debit. Alternatively,the user account engine 218 may already have this information and usepreviously stored financial information. The user account engine 218will charge the bakery 112/deli 155 the designated amount and authorizethe use of the image to complete the purchase.

The license engine 220, in some implementations, is a software enginethat includes information regarding the user's (e.g., a consumer's orbakery/deli employee's) license to certain images. The license engine220 interacts with the image library engine 212 and the location engine222 to ensure that the user may only search and select for purchaseauthorized licensed images. The location engine 222 informs the licenseengine 220 of the consumer's and/or bakery's/deli's geographic location.The license engine 220 determines whether restrictions exist on thesales of particular images in the consumer's and/or bakery's/deli'slocation. If restrictions exist, the license engine 220 requests thatthe image library engine 212 remove the unauthorized images from theimages available to the consumer. In some configurations, authorizedlists or pre-filtered searching options can be applied to the availablelicensed content such that a consumer or bakery/deli is pre-approved forfinding and/or downloading particular content. In some examples, thelicense engine 220 allows only those licensed images purchased by abakery 112/deli 155 to be presented for selection to a consumer who hasselected the bakery 112/deli 155 for producing the customized foodproduct.

The license engine 220, in some examples, interacts with the imageediting engine 214 to ensure that any licensing restrictions on imagesare followed. Once the user selects a particular image, the licenseengine 220 informs the image editing engine 214 if any licensingrestrictions exist that prevent the user from editing the selectedimage. If restrictions exist, the license engine 220 presents therestrictions to the user.

The location engine 222, in some embodiments, is a software engine thatidentifies consumers', bakeries', and delis' geographic locations. Incertain implementations, this may be accomplished by comparing the IPaddresses of the consumer computing device 122 and local control device128 against publicly available databases. In other embodiments, thelocation engine 222 determines a consumer's geographic location from anaddress list stored as account data 147 in data repository 129 and abakery's/deli's geographic location from an address list stored asbakery/deli data 149. For example, the location engine 222 accesses oneor more user address lists to determine which users reside in aparticular location. The address lists typically include a number ofusers with corresponding physical mailing addresses, zip codes, or cityand state designations. The location engine 222, in some examples,accesses the address lists to determine which geographic location isrelevant for a particular consumer or bakery 112/deli 155 and provides acatalog of images having proper licensing for the determined geographiclocation. In some examples, address lists can be generated by a vendoror third-party and sent to individual systems (such as system 100). Thesecondary user (e.g., consumer) address lists can be uploaded by aprimary user (e.g., a bakery/deli manager) using storage media oruploaded automatically over the Internet.

In some examples, the location engine 222 interacts with the licenseengine 220 and the image library engine 212 to ensure that the consumerand/or bakery/deli can only select and purchase images that are licensedin the geographical area. For example, if an image is licensed to besold or used in Canada, the same image may have requirements for use inthe United States. As such, the location engine 222 can use licenseengine 220 and image library engine 212 to ensure image licensingagreements are obeyed.

The location engine 222, in one example, interacts with the user accountengine 218 to ensure that a secondary user (e.g., a consumer) can onlysearch and select for purchase images that have been authorized by aprincipal user (e.g., a bakery or deli). When a user (consumer orbakery/deli) selects to search for an image from the image libraryengine 212, in some implementations, the location engine 222 identifiesthe user's location. The location engine 222 informs the user accountengine 218 of the user's location, so the user account engine 218 canidentify whether the user is a secondary user with geographicrestrictions on the authorized images available to the user. In someconfigurations, authorized lists or pre-filtered searching options canbe applied to the available licensed content such that a user ispre-approved for finding and/or downloading particular content, despitethe user location falling within a geographic restriction.

In another example, the location engine 222 determines a consumer'slocation based upon address information (e.g., a city and state or zipcode) provided by the consumer at the GUI 127, 171 as shown in FIGS.6E-F. In some implementations, as shown in FIG. 6F, the location engine222 uses the address information determined from the address informationinputs, IP address, or stored address lists to identify bakery/delilocations that are located in closest proximity to a consumer, and theconsumer selects a bakery/deli from the identified bakery/delilocations.

In some implementations, the training engine 224 is a software enginethat includes training content which instructs consumers on how to usethe user interfaces of the GUI 127, 171 to design and customize foodproducts. In some examples, the training engine 224 includes videos,lists of common questions and answers, diagrams, or training tutorials.

An instruction generation engine 230, in some implementations, is asoftware engine that converts the customized food product designed by aconsumer into decorating instructions that a bakery/deli employee canfollow to produce the food product according to the consumer's design.In some examples where the food product is a customized cake, thedecorating instructions produced by the instruction generating engine230 can include recipes and ingredient amounts for the cake and icing(e.g., amounts or ratios of food coloring to icing to obtain a desiredicing colors), cake dimensions (e.g., size and shape), edible mediaplacement for both two-dimensional (2D) and three-dimensional (3D)edible media, placement of cake toppers or other decorations, assemblyinstructions for 3D edible media, and print data for image files to beprinted on edible media. In some examples, the instruction generationengine 230 can dynamically adjust the ingredient amounts for acustomized food product based on the selected dimensions and attributesof the food product. Further, the decorating instructions can includeedible media printing instructions that can be generated by theinstruction generation engine 230 based on a type of edible media, typeof printer and/or printheads at the bakery 112, and/or attributes of theassembled 3D edible media. In some examples where at least one caketopper and background overlay are sold together in a set that may alsoinclude 2D and/or 3D edible media, the decorating instructions caninclude assembly instructions for all of the components in the purchasedset. For customized deli products, in some implementations, theinstruction generation engine 230 determines ingredient amounts andpreparation instructions for deli products designed by consumers. Forexample, the instruction generation engine 230 can determine amounts ofeach ingredient for preparing a customized fruit and vegetable tray withan edible media decoration based on the size and layout of itemsselected by the consumer at GUI 171.

In some embodiments, the instruction generation engine 230 can performcomputations for modeling and printing 3D edible media. In some exampleswhere a consumer provides customized dimensions for customized printed3D edible media, the instruction generation engine 230 performs thecomputations, modeling, and printing instruction generation based on thefeatures of the customized 3D edible media. In this way, the instructiongeneration engine 230 is able to customize generated decoratinginstructions to the unique specifications provided by the consumer.Therefore, the ability of the instruction generation engine 230 providesa technical solution to the technical problem of automating the creationof 3D edible media by dynamically customizing decorating instructionsfor 3D edible media to the unique preferences of the consumer. In anexample, the instruction generation engine 230 can compute a finiteelement model and/or structural mechanics to determine a center of massand stability of 3D edible media. In an example, the instructiongeneration engine 230 can compute a set of equations based on mechanicalstatics and dynamics in order to determine an interoperability of a 3Dedible media divided into multiple parts or two or more 3D edible media.In an aspect, the 3D edible media can be configured to divide intomultiple parts, or the one or more 3D edible media can be configured tointeract, based on an event such as melting, cutting, or breaking, of apart of the 3D edible media. In one example, a candle can be configuredto melt a part of the 3D edible media and create an event.

In an aspect each edible media material has a known density. In anaspect the instruction generation engine 230 can determine the center ofmass of the 3D edible media based on the density of the edible mediamaterial. In an aspect the instruction generation engine 230 candetermine a suitable base and attachment features for the 3D ediblemedia to prevent from dislocation or tipping. In an example, theinstruction generation engine 230 can determine a base with a set ofattachment features to compensate for the center of mass. In an aspectthe instruction generation engine 230 can determine one or more ediblemedia materials to print the 3D edible media such that it can have acenter of mass to prevent tipping or other unplanned movement. In anaspect the instruction generation engine 230 can determine one or moreedible media materials to print the 3D edible media such that it canhave a center of mass to result in a planned movement.

In some implementations, the instruction generation engine 230 can use a3D scan or digital data of the shape and appearance of the food product150 or other two or 3D element presented upon an edible media (e.g.,frosting sheet, cake top, etc.) to determine a feature of the 3D ediblemedia. In some embodiments, the instruction generation engine 230identifies the location of a 3D element and decorating instructions forthe three-dimensional element. In a first example, the 3D printer mayfirst print a 3D element (e.g., a frosting fish) and then later adddecorative elements to the 3D element (e.g., airbrush edible ink ontothe frosting fish). In a second example, the instruction generationengine 230 may identify placement of an off-the-shelf 3D elementpositioned on the edible substrate and alter the appearance of theoff-the-shelf-three-dimensional element using one or more printheadsand/or other features of the 3D printer (e.g., airbrush tool, reductivemodeling tool, etc.) to customize the appearance of the off-the-shelfthree-dimensional element. In a particular illustration, the instructiongeneration engine 230 may identify the position of a 3D edible figurineand modify the figurine to conform to image data by matching ormimicking the supplied image data (e.g. by adding facial features, hair,etc. a figurine of the birthday girl created from an off-the-shelfavatar). In some examples, the instruction generation engine 230 mayidentify the off-the-shelf 3D element based in part upon one or more ofa three-dimensional shape, a color, or a marking (e.g., barcode, QRcode) on the off-the-shelf 3D element.

In some implementations, a consumer accesses a website on the centralcontrol device 132 to gain access to the first set of software engines202. In some examples, the interact with the system 100 through aweb-based application at the consumer computing devices 122. Anauthentication engine 228, in some embodiments, interacts with anapplication management engine 234 to ensure that only authorizedconsumers gain access to the system. Upon successful verification of anauthenticated session between the software web browser on consumercomputing device 122 and central control device 132 via network 118, theauthentication engine 228 causes application management engine 234 toestablish a second connection to central control device 132 in parallelto the connection used by the software web browser on consumer computingdevice 122. In some implementations, the parallel connection isestablished automatically after authentication of a secure connectionfor the software web browser by authentication engine 228. In otherembodiments, the second connection is established upon user (consumer orbakery/deli) request. The application management engine 234 connectswith security engine 254. In certain implementations, applicationmanagement engine 234 may utilize the connection created by the softwareweb browser for communication with central control device 132.

In certain configurations, the second connection occurs over the network118 used by the software web browser. In other implementations, thesecond connection occurs over a network different from network 118. Theconnection established by the application management engine 234 can useidentical networking protocols or encryption protocols to the connectionutilized by the software web browser or can use a different networkingand/or encryption protocols. In some embodiments, the second connectionpersists despite the initial connection between the software web browseron consumer computing device 122 and central control device 132 beingterminated. In other configurations, the second connection terminatesconcurrently with termination of the first connection between thesoftware web browser on local control device 128 and the central controldevice 132.

In some implementations, the application management engine 234 utilizesthe secure socket connection with central control device 132 over thesecond connection. Access to software engines on central control device132, including the image library engine 212, are accessible to theapplication management engine 234 concurrently with accessibility fromthe software web browser on consumer computing device 122. In certainimplementations, the software web browser on consumer computing device122 is a generic web browser. The software web browser on centralcontrol device 132 can be implemented as 3.sup.rd party software, withclosed, proprietary, or undocumented application programming interfaces,and/or security profiles that deny access to system functions includinglocal file system access. In other embodiments, the software web browseron consumer computing device 122 provides a documented applicationprogramming interface (API) for the software web browser to interactwith other software installed on consumer computing device. Applicationmanagement engine 234 can co-exist on consumer computing device 122 witheither implementation of software web browser on consumer computingdevice.

In certain configurations, application management engine 234 provides astreamlined user interface for accessing software engines residing oncentral control device 132. The application management engine 234 can beimplemented in a variety of programming languages or developmentenvironments. In certain implementations, the application managementengine 234 can be implemented as an Adobe Integrated Runtime (AIR)application. In the AIR application, the application management engine234 acts as a cross-platform, browser-based runtime application. Inother embodiments, application management engine 234 can be implementedin C++ using Qt libraries. In the C++/Qt framework implementation, theapplication management engine 234 acts as a web-enabled cross-platformapplication and UI framework with access to system functions, such asthe local file system.

The application management engine 234 can be implemented as a RichInternet Application, providing both local file system access and remoteweb content access. For example, remote web content including but notlimited to thumbnail representations of licensed images from imagelibrary engine 212 can be downloaded by application management engine234 and stored in a local cache residing on the local file system ofconsumer computing device 122, providing low latency rendering of imagesduring image manipulation events including browsing and editing. Inother embodiments, the application management engine 234 is implementedin a software package complying with security policies that permitremote web content access, but not local file system access, or viceversa. Local cache contents are in a custom format that prevents systemusers (consumers or bakery/deli personnel) from extracting local cachecontents for unauthorized editing and/or printing of cached licensedimages.

The application management engine 234 on consumer computing device 122exchanges data with central control device 132 over the same networkconnection established by the software web browser. In selectimplementations, the software web browser utilized an unsecuredconnection such as HTTP (Hypertext Transfer Protocol). The software webbrowser utilizes a secured connection such as HTTPS (HTTP with securesocket layer (SSL)/transport layer security (TLS)), performing securityprocedures including but not limited to server authentication, clientauthentication, and secure encryption key exchange.

The application management engine 234 on consumer computing device 122exchanges data with central control device 132 over a network connectiondifferent than the network connection established by the software webbrowser. The separate connection established by the applicationmanagement engine 234 can either be secured or unsecured, independent ofif the software web browser connection is secured or unsecured.

The application management engine 234 is capable of sending andreceiving separate classes of data on different connections and/ordifferent connection security profiles. For example, image data fromimage library engine 212 may be received by the application managementengine 234 over an unsecure HTTP connection between the applicationmanagement engine 234 and the central control device 132, whilefinancial data may be sent from the consumer computing device 122 tocentral control device 132 over a secure connection established by thesoftware web browser. In another example embodiment, both image data andfinancial data may be sent over a secure connection established byeither the software web browser or the application management engine234.

In some implementations, application management engine 234 is associatedwith network address identification information. In certain embodiments,network address identification information allows engines residing onthe consumer computing device 122 and central control device 132 tointeract with one another without networks external to the consumercomputing device 122 and central control device 132, such as a LAN, MAN,or the Internet. In other embodiments, network address identificationinformation only allows engines residing on the consumer computingdevice 122 and central control device 132 to interact with one anotherthrough an external network connection, with or without messages passingthrough the central control device 132.

Application management engine 234 and the software web browser on theconsumer computing device 122 communicate with a pre-defined messageformat and message exchange patterns. In an illustrative embodiment, theSimple Open Access Protocol (SOAP) is utilized. Alternativescommunication schemes for exchanging complex data structures include butare not limited to Extensible Markup Language-Remote Procedure Call(XML-RPC) and JavaScript Object Notation (JSON).

Marketing automation engine 235, in some implementations, is a softwareengine that controls generation and transmission of targeted marketingmaterials to individual consumers as well as different demographicgroups of consumers. In some examples, the marketing automation engine235 extracts, organizes, and saves marketing data 153 in data repository129. The marketing data 153, in some examples, may include numbers ofeach type of ordered customized food product that can be broken downinto individual component categories corresponding to selections made byconsumers at user interface screens for designing a customized foodproduct (see FIGS. 6A-6R). For example, the marketing data 153 caninclude numbers of cakes that have been ordered over a period of timethat have a particular color or flavor of icing, filling flavor, cakeflavor, size and shape, type of 2D and/or 3D edible media, celebrationoccasion, type of decoration or topper, and type of prepackageddecorating set. For customized deli products, the marketing data 153 caninclude numbers of each type of deli product that have been ordered overa period of time that with particular ingredient, size, and edible mediaselections. For each of the individual component categories, themarketing data 153 may include demographic information relating to thetypes of people who order each type of individual cake component or typeof deli product (e.g., age, gender, geographical region, marital status,parental status). In some examples, the marketing data 153 may beorganized by market associated with each bakery 112/deli 155 thatinteracts with the system 100.

The marketing automation engine 235, in some embodiments, uses themarketing data 153 to generate targeted marketing materials that can besent from bakery 112/deli 155 to consumers at consumer computing devices122. In some implementations, the marketing automation engine 235, onbehalf of a bakery 112/deli 155, transmits marketing materials via emailor social to consumers. In other examples, the marketing materials maybe presented to consumers logging in to their respective user accountsat a website and/or API for the system 100. In some aspects, themarketing materials presented to a consumer may be based on previouscustomized food product orders submitted by the consumer or ademographic category of the consumer. For example, if the consumer isthe parent of a five-year-old girl, the marketing automation engine 235may present marketing materials to the consumer related to unicorn cakesor princess cakes. If, in another example, a consumer has previouslyordered sports-themed cakes, the marketing automation engine 235 maypresent marketing materials to the consumer related to othersports-themed cakes.

The marketing automation engine 235, in some embodiments, may alsogenerate marketing materials for third-party vendors 115 marketing tobakeries 112 and consumers. In some implementations, the marketingautomation engine 235, on behalf of a third-party vendor 115, transmitsmarketing materials via email or social media to bakeries 112/delis 155.In other examples, the marketing materials may be presented tobakery/deli personnel logging in to their respective user accounts at awebsite and/or API for the system 100. In some embodiments, thethird-party vendors 115, such as decorating product vendors, can market2D and 3D edible media, cake toppers, prepackaged decorating sets, orany other decorations that can be used to decorate customized foodproducts.

In some implementations, the second set of software engines 204 mayinclude an inventory management engine 236, a customer administrationengine 238, a printer communication engine 242, a color managementengine 244, a print engine 246, and a 3D print engine 247. The describedsoftware engines can be selectively combined to form a multifunctionalsoftware engine or split into multiple software engines.

The inventory management engine 236, in some embodiments, is a softwareengine that manages inventory for bakery 112/deli 155 to monitorinventory status and provide for reordering edible media, edible ink,replacement parts, printheads, consumable decorating products (e.g.,cake toppers, decorating kits, decoration sheets, candles) and foodproduct ingredients (e.g., icing, food coloring, flour, eggs, milk). Forcustomized deli food products, in some embodiments, inventory items mayalso include deli-related food items (e.g., meat, cheese, produce, andbread product distributors) and consumable material products (e.g.,disposable deli trays). In some examples, bakery/deli employees can scanan inventory item with a scanner connected to the local control device128 or manually input the inventory item information at the customerdisplay device 131 as the inventory item is consumed. Additionally, thebakery/deli employee may input the unique code associated with an ediblemedia item. In some implementations, the inventory management engine 236is configured to automatically and dynamically adjust amounts of one ormore inventory items upon receiving a signal from local control device128 that preparation of a respective customized food product iscomplete. For example, the inventory management engine 236 canautomatically determine the amounts of each inventory item that havebeen used based on the dimensions, flavors, and other customizationselections for the respective customized food product and adjust thequantities of the inventory items accordingly. The current status of theinventory items at the bakery is stored as inventory data 145 of datarepository 129. In some examples, the inventory data 145 may alsoinclude a consumption rate of inventory items, which allows theinventory management engine 236 to predict when an inventory item mayrun out.

In some examples, the inventory management engine 236 may initiateorders for 2D and 3D edible media and associated printing materials,food product ingredients (e.g., quins, sprinkles, sugars, food colorssuch as airbrush colors and gel colors, confections, etc.), decoratingproducts such as cake toppers and prepackaged decorating sets, and anyother food product accessories (for example, candles for a birthdaycake) based on receiving an inventory order submission from the localcontrol device 128. In some implementations, the inventory managementengine 236 presents one or more web order forms for the third-partyvendors 115 within the GUI 157 at the customer display device 128, andbakery/deli employees manually initiate orders with the third-partyvendors 115. Additionally, the inventory management engine 236 can alsotransmit automatic notifications to the local control device 128 tonotify the bakery 112 that a particular inventory item is running low.

Automatic ordering engine 237, in some implementations is a softwareengine that controls automatic ordering of inventory items for bakeries.In some embodiments, when an amount of a particular inventory item isless than a predetermined threshold, the inventory management engine 236transmits the inventory item information to the automatic orderingengine 237 with an automatic order request. In response to receiving theautomatic order request, the automatic ordering engine 237 establishes aconnection with web ordering systems of corresponding third-partyvendors 115 and completes a transaction for the particular inventoryitem. For example, the system 100 may communicate with the third-partyvendors 115 through a business-to-business e-commerce website. In otherexamples, the system 100 may communicate with the third-party vendors115 via any other type of electronic communication methods, which caninclude electronic data interchange (EDI), phone, facsimile, or websitecommunications. Additionally, the automatic ordering engine 237, in someexamples, updates the status of the ordered items (e.g., estimatedshipping date, amount ordered, estimated delivery date), which is storedas part of inventory data 145 in data repository 129. In some examples,the system can use the status of the automatically ordered items tocompute the lead time for a customized food product order at bakery112/deli 155. In some implementations, automatic ordering engine 237 mayautomatically initiate orders for any type of inventory item based on aconsumption rate detected by the inventory management engine 236.Further, the automatic ordering engine 237 can dynamically adjust anordering date and/or automatically initiate orders for inventory itemsbased on a number of currently pending orders at the bakery 112/deli 155as well as historical ordering information for the bakery 112/deli 155.

The system 200, in some examples, includes a customer administrationengine 238 that manages the interactions that the bakery 112/deli 155has with the system 100. In some implementations, the customeradministration engine 238 receives decorating instructions and ediblemedia print data for customized food product orders and displays ordersummary information on a bakery administrative user interface screen(for example, user interface 800 in FIG. 8). For example, the ordersummary information may include an order identification number, a pickupdate, a descriptive name for the food product, a price, an order source(e.g., consumer computing device, kiosk), and a current status.

In some examples, the customer administration engine 238 determines aprocessing order for the received orders at the bakery 112/deli 155based on a number of factors that may include pickup date, orderreception date, type of edible media for the order, inventory at thebakery 112/deli 155, preparation lead time for the order, and detailsfor other orders that are in progress at the bakery 112/deli 155. Insome embodiments, customer administration engine 238 is configured todetermine an optimal edible media printing order for the printer 134 atthe bakery 112/deli 155. For example, a bakery or deli may receive foodproduct orders for multiple types of printed 2D and 3D edible media andfood products that have varied preparation lead times. The customeradministration engine 238, in some implementations, can determine aprint queue order for multiple edible media prints associated withmultiple orders that maximizes throughput and efficiency.

In some examples, the customer administration engine 238 can dynamicallyadjust the print queue order based on attributes, decoratinginstructions, and pick-up times for incoming customized food productorders. For example, when the local control device 128 receives anincoming customized food product order, the customer administrationengine 238 can assign the associated edible media print to be printedwith other orders that are printed on the same type or size of ediblemedia. In some implementations, the customer administration engine 238may dynamically adjust a print queue order based on edible ink levels inthe printer 134 at the bakery 112/deli 155 so that the ink levels ofeach of the ink colors in the printheads of the printer 134 are used ata substantially similar rate. For example, the printer 134 may transmita status signal to the local control device 128 and/or central controldevice 132 with current levels or amounts of ink remaining in each ofthe installed printer cartridges. Determining the print order based onink levels reduces the number of times that bakery employees have tostop production to change out and/or refill ink cartridges becausemultiple cartridges are at replacement ink levels around the same time.In some implementations, the print queue order may correspond to thepreparation queue order for the pending customized food product ordersat the bakery 112/deli 155. In other examples, such as when multiplecustomized food product orders are prepared within a short period oftime such as a few hours or within a work day, the print queue order mayvary from the preparation order to ensure maximum printing throughputand efficiency without compromising food product quality at pick-uptime. For example, the customer administration engine 238 may determinethe print queue order to ensure that the printed edible medium for theorder is printed within a predetermined time period of when preparationof its respective customized food product order is projected to becompleted based on its position in the preparation queue. In someexamples where a bakery 112/deli 155 has more than one printer 134, thecustomer administration engine 132 may select a particular printer 134for printing the printed edible medium based on a type of printheadattached to the selected printer 134. In instances where an edible mediasheet includes multiple edible substrates of the same type, size, andshape, the customer administration engine 238 may adjust the order ofedible media prints such that the printer 134 prints onto each of theedible media substrates on the sheet in a single printing session, whicheven further reduces the number of human interactions with the printerand thereby increases printer throughput. In this way, the system 100provides a technical solution to the technical problem of automatingedible media printing in an efficient and cost-effective manner thatreduces processing speeds and improves system throughputs. Specifically,dynamically and automatically adjusting the print queue order removesmany manual human interactions with the system 100. In other examples,the printer 134 may print onto the edible media in a first-in, first-outorder.

In some implementations, the customer administration engine 238 mayadjust an edible media printing order based on allergy restrictionsassociated with an incoming customized food product order. In someexamples, the customer administration engine 238 can transmit print datafor customized images created by consumers to a specific printer 134 atthe deli based on food allergies associated with a customized foodproduct order. For example, if an order includes an indication of apeanut allergy, the customer administration engine 238 may transmit theprint data for the order to a printer 134 in a “peanut free” zone of thebakery or deli and/or adjust the order of edible media printing toaccommodate the incoming order with allergy restrictions.

In some implementations, the customer administration engine 238 maypresent the orders at the bakery 112/deli 155 in a user interface screenhaving a calendar format. In some examples, the calendar user interfacescreen may display an event that corresponds to when an order isscheduled to be picked up as well as an event for when the bakery112/deli 155 needs to commence order production to have the order readyon time. In some embodiments, the customer administration engine 238 canadjust the placement of events on the calendar user interface screen inreal-time based on adjustments to the processing order due to otherincoming orders or inventory status.

In some implementations, the customer administration engine 238 isconfigured to calculate and/or adjust preparation lead times forcustomized food products based on dynamically changing conditions at thebakery 112/deli 155. For example, the customer administration engine 238can increase or decrease preparation lead times based on numbers ofemployees that are projected to work each day or are currently working.The preparation lead times can also be updated based on the dynamicallychanging quantities of inventory items at the bakery 112/deli 155 asother customized food product orders are being prepared. In someexamples, if the preparation lead time for a customized food productorder increases to a date or time that is later than the requestedpick-up time, then the customer administration engine 238 communicatesthe updated preparation lead time information to the messaging engine252 to automatically transmit a message to the consumer regarding thestatus of the customized food order. Similarly, consumers may also benotified if the customized food product order is projected to be readyfor pick-up ahead of schedule.

In some implementations, the customer administration engine 238 controlsthe operation and presentation of customized APIs for each bakery112/deli 155 interacting with the system 100. In some examples, datarepository 129 stores customized API data for each bakery 112/deli 155as bakery/deli data 149. For example, a bakery 112/deli 155 may receivecustomized food product orders through a general website associated withthe system 100 but may have product preparation and workflow processesthat are unique to the bakery 112/deli 155. The customized API for thebakery 112/deli 155 can present the order information and decoratinginstructions for customized food products in a format that is tailoredto the processes of the bakery 112/deli 155. The APIs for each bakery112/deli 155, in some embodiments, provide the flexibility to adapt tochanges in preferences at each respective bakery 112/deli 155interacting with the system 100 without affecting the interfaces ofother bakeries 112/delis 155 with the system 100.

In some implementations, the customer administration engine 238 includesthe functionality of the application management engine 234 describedabove for interactions between the central control device 132 and thelocal control device 128. Additionally, the customer administrationengine 238 can be configured to bypass existing print drivers providedby the operating system when printing. When bypassing operating systemprint drivers, customer administration engine 238 interacts with a colormanagement engine 244. The color management engine 244 provides colormatching and correction to print data provided by print engine 246 or 3Dprint engine 247 on central control device 132. Color encoding on printdata propagating from print engine 246 or 3D print engine 247 may beindexed by a color representation scheme as known in the art.

In certain configurations, the color representation scheme is asdescribed by the International Color Consortium (ICC). The ICCspecification uses the CIE color profile and is widely used and isreferred to in many International and other de-facto standards, and wasapproved as an International Standard, ISO 15076-1, which isincorporated herein by reference. A standardized color representationscheme such as the ISO 15076-1 ensures color rendition accuracy despitevariations in color detection and production across image capturedevices (e.g., scanners), image display devices (e.g., monitors), andimage reproduction devices (e.g., printers). Color management engine 244provides a color managed workflow from source image to printer output,applying color representation transformations that ensure accurate colorrepresentation in each color domain. The general principles of colormanaged workflows using the ICC Color Management Model have beendescribed variously, for example in U.S. Pat. No. 7,161,710 to MacLoed,et al, assigned to Adobe Systems Incorporated, which is incorporatedherein by reference.

In some implementations, color profile information is embedded in theimage provided by the print engine 246 or 3D print engine 247. In otherembodiments, color profile information is retrieved separately from theimage data provided by the print engine 246 or 3D print engine 247. Incertain configurations, a separate image color profile for the customerdisplay device 131 or consumer computing device 122 is applied to theretrieved image. In other implementations, the customer display device131 or consumer computing device 122 is not color corrected using anycolor profile. Application of color correction to print devices isindependent of application of color correction to display devices. Incertain embodiments, bakery 112 can automatically retrieve thecorresponding color profile for a printing device (e.g., printer 134)connected to local control device 128 based on hardware modelinformation for printer 134. In other cases, the bakery 112 can provideits own color profile based on color spectrography measurementsperformed on printed outputs of printer 134.

The color management engine 244, in some implementations, interacts witha printer communication engine 242. The printer communication engine 242provides communication to a printer device connected to local controldevice 128 without utilizing printer drivers installed on the operatingsystem on local control device 128. In certain configurations, printercommunication engine 242 automatically detects the model number of theattached printer 134, and downloads corresponding software through thesecond connection established by the customer administration engine 238.In other implementations, printer communication engine 242 includespre-installed software for several different print hardwaremanufacturers and/or vendors. In further embodiments, printercommunication capabilities provided by the printer communication engine242 are not dependent on specific cartridge reservoirs utilized by theprinter.

The print engine 246 is a software engine that allows bakery/deliemployees to print images onto 2D and 3D edible media using the system100. Once the bakery 112/deli 155 receives the image data to be printedonto edible media for the customized food product designed by theconsumer, in some examples, the bakery 112/deli 155 selects to print theimage. In some implementations, the print engine 246 and/or 3D printengine 247 can automatically initiate printing onto edible media at theprinter 134 in accordance with the print queue order determined by thecustomer administration engine 238. The print engine 246 allows thebakery 112/deli 155 to preselect default printer model information,which can be stored within the print engine 246. In someimplementations, the print engine 246 selects a color profile based onprinter model information stored within print engine 246. Alternatively,print engine 246 can perform hardware communication with the printer todetermine printer model information for the purposes of selecting acolor profile. In another illustrative embodiment, print engine 246allows the bakery 112/deli 155 to select a color profile.

The print engine 246, in some examples, provides data from the centralcontrol device 132 to the local control device 128 for printing on a 2Dor 3D edible media printer attached to the local control device 128. Incertain embodiments, the local control device 128 may print dataprovided by the print engine 246 within a print environment providedinternally by a software web browser used to navigate the website withat least one image database. In other configurations, a local controldevice 128 may print data provided by the print engine 246 in anexternal printing environment provided separately from the software webbrowser used to navigate the website with at least one image database.

Print engine 246 interacts with the edible media engine 216 to verifythat the bakery 112/deli 155 inputs a code, such as an edible mediacode, that corresponds to an authorized edible media. In some examples,the inventory management engine 236 verifies that the code is valid andunused before the print engine 246 proceeds with sending data to thelocal control device 128 for printing.

In some implementations, the print engine 246 manages printing onto both2D and 3D edible media. In other examples, a 3D print engine 247controls printing of 3D edible media, which can include monitoring theprinting and assembly of each component of 3D edible media based on thedecorating instructions received from the instruction generation engine230.

The maintenance engine 248 is a software engine that includesmaintenance menus for updating software, hardware, or inventory. Themaintenance engine 248 can additionally provide troubleshootinginstructions, printer maintenance features, testing functions, andcleaning functions.

In some implementations, the third set of software engines 206 mayinclude a maintenance engine 248, a reporting engine 250, a messagingengine 252, and a security engine 254. The described software enginescan be selectively combined to form a multifunctional software engine orsplit into multiple software engines.

The reporting engine 250 is a software engine that includes mechanismsfor reporting on sales, inventory, consumers, errors, malfunctions, andother events occurring in system 200 a. In some embodiments, reportingdata can be exported to comma delimited files, Excel files, or exportedto particular reporting software. The reporting engine 250 canadditionally provide site metric reporting via site metric reportingsoftware.

The messaging engine 252 is a software engine that includes mechanismsfor generating and sending electronic messages to users (consumers atconsumer computing devices 122 and bakeries at local control devices128). For example, the messaging engine 252 may send an electronicmessage to specific consumer accounts or groups of consumer accountsbased on previous purchases. The messaging engine 252 may send systemreceipts or other billing information in the form of a message. In someconfigurations, the messaging engine 252 sends messages to bakeries112/delis 155 regarding system updates or image updates. In someimplementations, the messaging engine 252 provides for message exchangebetween the bakery 112/deli 155 and consumers. For example, abakery/deli employee transmits a message to a consumer computing device122 if an unexpected delay occurs during preparation of the customizedfood product. Additionally, consumers can notify the bakery if they haveany adjustments to a previously submitted order.

Security engine 254 is a software engine that handles secure socketconnections from local control device 128. For example, followingauthentication through login procedures through a software web browser,central control device 132 can establish additional secure connectionsto the consumer computing device 122 or local control device 128 withsoftware engines separate from the software web browser. Functionalitynot incorporated into the software web browser on consumer computingdevice 122 or local control device 128 can interact with the softwareengines on central control device 132 through security engine 254.Interaction with software engines on central control device 132 canproceed through multiple software applications on consumer computingdevice 122 or local control device 128. In certain implementations,security engine 254 handles secure transmission of both licensed imagedata and financial data for purchases of licensed images. In otherillustrative implementations, security engine 254 handles securetransmission of financial data for purchases of licensed images but doesnot apply security policies to licensed image data. In certainembodiments, HTTP (hypertext transfer protocol) can be used fortransmitting payment and/or image data, such as in the form of unsecuredHTTPS or secured HTTPS. In other embodiments, FTP (file transferprotocol) can be used for transmitting payment and/or image data.Alternatively, SMTP (simple mail transfer protocol) can be used for datatransfer.

In some implementations, the fourth set of software engines 208 mayinclude a kiosk control engine 256 and additional system engines 258.The described software engines can be selectively combined to form amultifunctional software engine or split into multiple software engines.

Kiosk control engine 256, in some implementations, is a software enginethat controls operation of kiosk 161 in the system 100 b. In someexamples, the kiosk control engine 256 manages the presenting of userinterface screens at the kiosk 161 and processing food productcustomization orders received at the kiosk or at a device 163 connectedto the kiosk 161. In some implementations, the kiosk control engine 256controls operation of at least one short range communication accesspoint at the kiosk 161 that enables devices 163 to connect to the kiosk161 to increase the number of orders that can be processed and receivedby the kiosk 161. In some implementations, the kiosk control engine 256may search for consumer computing devices 163 within communication rangeof the kiosk 161. When an in-range consumer computing device 163 isdetected, the kiosk control engine 256 may initiate a connection querytransmission to the device 163 to determine whether the consumer isinterested in connecting the consumer computing device 163 to the kiosk161 to design a customized food product. In other examples, consumeroperating devices 163 may manually search for and establish acommunication link with the kiosk 161 via the network 165.

In one example, the kiosk control engine 256 monitors the number ofconnected devices 163 and determines whether there is a channel slotavailable for a newly detected device 163. In some examples, if thereare no channel slots available for the newly detected device 163, thekiosk control engine 256 calculates an estimated time of availability(ETA) for the device based on an in-progress order status for consumersat the other connected devices. In one example, the kiosk control engine256 can determine the ETA based upon which user interface screen aconsumer is currently viewing. For example, a consumer who is currentlyviewing an order review user interface screen is closer to completingthe process of designing a customized food product than a consumer whois editing a photo to print on an edible medium. In some examples, whena consumer computing device 163 connects to the kiosk 161 via thenetwork 165, the kiosk control engine 256 establishes a master-slaverelationship between the kiosk 161 and the consumer computing device 163where the kiosk 161 is the master. For example, upon connection to aconsumer computing device 163, the kiosk 161 may cause presentation ofone or more food product customization user interfaces screens at thedevice 165 such that the device 165 functions as an input/output device,and the kiosk 161 presents the customization and editing options to theconnected device 163 at the user interface screens and also receives andprocesses inputs that are provided by consumers at the user interfacescreens. In some examples, when the device 163 is connected to the kiosk161, the kiosk control engine 256 disables most or all otherfunctionality of device 163 so that the consumer can only interact withthe system 100 b via the kiosk 161.

In some embodiments, the kiosk control engine 256 can also controlinteractions between consumer computing device 163, central controldevice 132, and kiosk 161 that allow a consumer to directly uploadimages for use at the kiosk 161 via a system-supplied URL link. Forexample, as shown in FIG. 6P, the kiosk control engine 256 can provide auser contact information user interface (UI) screen 617 to kiosk 161. Atthe UI screen 617, a consumer can provide a phone number 619 and/oremail address 621 that can be used to interact with the system 100 c andkiosk 161. For example, responsive to a consumer providing a phonenumber 619, the kiosk control engine 256 can cause a text message to betransmitted to the consumer computing device 163, as shown in mobilemessaging interface 623 in FIG. 6Q. The mobile messaging interface 623can include a web URL 625 that allows a consumer to access a photoupload interface 627 (FIG. 6R) for uploading one or more photos to thesystem 100 c. In some examples, the photo upload interface 627 enablesthe consumer to select a photo 629 stored on the consumer computingdevice 163 for upload to the system 100 c and provide a message 629 tothe bakery 112/deli 155 with customized information about the photo. Insome examples, upon uploading a selected photo to the system 100 c, theconsumer can use UI screens at the kiosk 161 to access the uploadedphoto, add the photo to a customized food product, and edit the photowithin food product customization UI screens. In one example, theinteractions between the central control device 132, kiosk 161, andconsumer computing device 163 for providing images from the consumercomputing device 163 for use at the kiosk 161 can be controlled by acloud-based messaging platform.

Additional engines 258 can be included in system 200. For example,service oriented third-party applications can be merged or supplied asadd-ins as appropriate. Similarly, online advertising content, Internetaccess, FLASH applications, database management, online shopping, andother services may be offered in system 200. Additionally, mediaplayers, advertising displays, and other services may be offered insystem 200.

System Processes

Turning to FIGS. 3A-3C, a method 300 of designing a customized foodproduct is illustrated. While the method 300 is described herein withrespect to customizing bakery food products with edible media at GUI 127(FIGS. 1A, 1K), the method 300 can also be applied to customizing delifood products at GUI 171 (FIG. 1L). In certain embodiments, the method300 may commence when the system 100 receives login credentials from aconsumer at GUI 127 (302), and user account engine 218 validates thelogin credentials (304). If a user does not have a registered accountwith the system 100, in some examples, user account engine 218 maypresent an account registration user interface screen where the consumercan create login credentials for logging into the system (for example,FIG. 6N).

If there are any previously completed or in-progress projects associatedwith the consumer stored as project data 143 in data repository 129(306), then the user account engine 218, in some examples, accesses anystored projects so that the consumer can continue editing an in-progressproject or design another food product based on a previously completedproject (308).

In some examples, the system 100 receives a project completion date forthe project from the consumer at GUI 127 (310). In some embodiment, theGUI 127 includes a selection where the consumer can indicate a desirefor a same-day order pickup (input field 602 in FIG. 6A.) If a consumerdoes not have a default bakery associated with the consumer's logincredentials (312), then in some examples, location engine 220 receiveslocation information for the consumer (314), either from locationinformation input fields (for example, input field 638 of user interfacescreen 636 of FIG. 6F, positional data (e.g., GPS data) or IP addressdata for consumer computing device 122, or stored address data for theconsumer. In some embodiments, the GUI 127 provides the consumer with anoption to check out as a guest without providing login credentials.

In some embodiments, the location engine 220 presents one or more bakeryselections to the consumer (316) (for example, bakery selections 640 atuser interface screen 636 of FIG. 6F) based on the consumer locationinformation, and in some aspects, the consumer selects one of thepresented bakery selections (318). In some implementations, theconsumer-facing design engine 210 calculates a lead time for preparingthe food product based on an inventory status and current workload ofthe selected bakery (320). If the consumer is unsatisfied with the leadtime of the selected bakery (322), the consumer can select anotherbakery that has a lead time that is acceptable to the consumer (316,318).

The consumer-facing design engine 210, in some implementations, presentsone or more user interfaces (for example, FIGS. 6H-6K and FIGS. 7A-7D),to the consumer at the GUI 127 on the consumer computing device 122 thatallow the consumer to make design selections for a customized foodproduct (for example, a cake) from start to finish without interactingwith personnel at the bakery 112 (324). In some examples, the designselections include photo selection and editing, licensed and unlicensedimage selection, cake size and shape selection, text placement andediting, cake filling selection, icing color and flavor, cake topperselection, and selection of additional accessories (e.g., birthdaycandles). In some implementations, the consumer-facing design engine 210only presents design selections that are available at the bakery 112selected by the consumer. The consumer-facing design engine can, in someexamples, present the unavailable design selections at the userinterface screen with an indication that a particular design selectionis unavailable at the selected bakery (for example, through anadjustment in hue of the unavailable selection or with the words“unavailable at the selected bakery” below the selection). If theconsumer wishes to select the unavailable selection, the consumer canchoose another bakery that offers the desired design selection.

In one example, the consumer-facing design engine 210 is configured torecalculate the lead time for the selected bakery after each foodproduct design selection that is made at the GUI 127. If the designselection affects the previously presented lead time and/or the adjustedlead time is after the consumer's desired pickup date (328), theconsumer-facing design engine 210 may output a notification to the GUI127 at the consumer computing device 122 indicating that the lead timeis affected (330) so that the consumer has an opportunity to makeanother design selection or select another bakery.

In some implementations, with each design selection that is made by theconsumer, the consumer-facing design engine 210 updates a pricesub-total for the customized food product in real-time (332) such thatthe price indicated on the user interface screen includes all of thedesign selections made by the consumer up to that point. In someexamples, when the consumer has made all of the design selections forthe customized food product (336), the consumer-facing design engine 210presents an order review user interface screen (for example, userinterface screen 678 in FIG. 6L) that includes all of the selectionsmade by the consumer, the pickup date, bakery location, and price total(338). Once the consumer submits the order and the order is received bythe system 100, in some examples, the consumer-facing design engine 210presents an order confirmation user interface screen at the consumercomputing device (for example, FIG. 6M) (340).

In some examples, once the customized food product order is received bythe system 100, instruction generation engine 230 converts the designselections for the food product into a set of decorating instructionsfor a bakery/deli employee to follow to produce the food product (342).In some examples where the food product is a customized cake, thedecorating instructions produced by the instruction generating engine230 can include recipes and ingredient amounts for the cake and icing(e.g., amounts or ratios of food coloring to icing to obtain a desiredicing colors), cake dimensions (e.g., size and shape), edible mediaplacement for both two-dimensional (2D) and three-dimensional (3D)edible media, assembly instructions for 3D edible media, and print datafor image files to be printed on edible media.

If the food product order includes printed 2D or 3D edible media (344),then in some examples, customer administration engine 238 determines aprinting order for the edible media based on other pending food productprojects that include printed edible media (346). The customeradministration engine 238, in some implementations, can determine aprint queue order for multiple 2D or 3D edible media prints thatmaximizes throughput and efficiency. The customer administration engine238, in some embodiments, may also determine a food product preparationorder for the incoming project based on a number of factors that mayinclude pickup date, order reception date, type of edible media for theorder, inventory at the bakery 112, preparation lead time for the order,and details for other orders that are in progress at the bakery 112(348).

In some implementations, the customer administration engine 238 displaysorder summary information on a bakery administrative user interfacescreen (for example, user interface 800 in FIG. 8) (350). For example,the order summary information may include an order identificationnumber, a pickup date, a descriptive name for the food product, a price,an order source (e.g., consumer computing device, kiosk), and a currentstatus. The customer administration engine 238, in some examples, canalso adjust the placement of events on the calendar user interfacescreen in real-time based on adjustments to the processing order due toother incoming orders or inventory status (352).

When the bakery 112 has completed preparing a customized food productorder, in some embodiments, a bakery/deli employee can transmit an ordercompletion notification from local control device 128 to central controldevice 132 through an interaction with the bakery administrative userinterface screen (354). Upon receiving the notification, in someexamples, the central control device 132 forwards the order completionnotification to the consumer computing device 122 to notify the consumerthat the order is ready for pickup (356).

Upon completion of preparing the customized food product order, in someimplementations, inventory management engine 236 updates amounts ofinventory items to reflect the consumption of the inventory items (e.g.,ingredients, decorations, toppers, prepackaged decorating sets, 2D and3D edible media) for the customized food product order (358). Forexample, for an 8-inch round chocolate cake with vanilla icing decoratedwith a princess decorating set, the inventory management engine 236decrements the amounts of ingredients that correspond to the recipe foran 8-inch chocolate cake and decrements the inventory amount of princessdecorating sets.

If an amount of any of the inventory items managed by the system 100 isless than a predetermined threshold (360), then in some implementations,the inventory management engine 236 triggers an automatic orderingengine 237 to initiate an inventory item order at an applicable with anapplicable third-party vendor 115 (362). In response to receiving theautomatic order request, the automatic ordering engine 237 establishes aconnection with web ordering systems of corresponding third-partyvendors 115 and completes a transaction for the particular inventoryitem. For example, the system 100 may communicate with the third-partyvendors 115 through a business-to-business e-commerce website. In otherexamples, the system 100 may communicate with the third-party vendors115 via any other type of electronic communication methods, which caninclude electronic data interchange (EDI), phone, facsimile, or websitecommunications. In other examples where the system is configured formanual inventory ordering, the inventory management engine 236 maytransmit a notification to local control device 128 at bakery 112 tonotify bakery/deli personnel that they are running low on at least oneinventory item and should initiate a product order for the at least oneitem.

While the flow charts described with respect to FIGS. 3A-3C illustratean ordering of one or more blocks or steps, it can be understood thatthat steps can be performed in any order, in series, or in parallel. Insome implementations, multiple steps may be performed simultaneously bydifferent processing engines. For example, determining an edible mediaprinting order (346) may be executed simultaneously with determining afood product preparation order (348). In other examples, presenting andreceiving the bakery selections (316, 318) may be performed before orsimultaneously with receiving the project completion date (308).

Turning to FIG. 4, a method 400 of interacting with a system fordesigning and producing customized bakery and/or deli food products withedible media through a kiosk, such as kiosk 161 (FIG. 1K, 1L) isillustrated. In certain embodiments, the method 400 may commence whenthe kiosk 161, which includes circuitry for providing a short rangecommunication access point, detects a device 163 within communicationrange of short range communication network 165 (402). When an in-rangeconsumer computing device 163 is detected, the kiosk control engine 256may initiate a connection query transmission to the device 163 todetermine whether the consumer is interested in connecting the consumercomputing device 163 to the kiosk 161 to design a customized foodproduct. In other examples, consumer operating devices 163 may manuallysearch for and establish a communication link with the kiosk 161 via thenetwork 165.

If there are currently no open channel slots for the detected device(404), then in some examples, the kiosk control engine 256 calculates anestimated time of availability (ETA) for the device 163 based on anin-progress order status for consumers at the other connected devices(406). In one example, the kiosk control engine 256 can determine theETA based upon which user interface screen a consumer is currentlyviewing. For example, a consumer who is currently viewing an orderreview user interface screen is closer to completing the process ofdesigning a customized food product than a consumer who is editing aphoto to print on an edible medium. When a channel slot becomesavailable, in some examples, the kiosk access point establishes acommunication link on the network 165 connecting the device 163 to thekiosk 161 (408).

When the device 161 connects to the kiosk 161 via the network 165, insome implementations, the kiosk control engine 256 configuresmaster-slave settings between the kiosk 161 and the consumer computingdevice 163 where the kiosk 161 is the master (410). In one example, uponconnection to a consumer computing device 163, the kiosk 161 may causepresentation of one or more food product customization user interfacesscreens at the device 165 such that the device 165 functions as aninput/output device, and the kiosk 161 presents the customization andediting options to the connected device 163 at the user interfacescreens and also receives and processes inputs that are provided byconsumers at the user interface screens (412). In some examples, whenthe device 163 is connected to the kiosk 161, the kiosk control engine256 disables most or all other functionality of device 163 so that theconsumer can only interact with the system 100 b via the kiosk 161.

While the flow charts described with respect to FIG. 4 illustrate anordering of one or more blocks or steps, it can be understood that thatsteps can be performed in any order, in series, or in parallel. In someimplementations, multiple steps may be performed simultaneously bydifferent processing engines. For example, determining whether an openchannel slot is available for a detected device (404) may be executedsimultaneously with or subsequent to calculating an ETA for an open slot(406).

System User Interfaces

Turning to FIGS. 5A-B, a workflow 500 for presentation of cakecustomization user interface (UI) screens at a consumer computing deviceor kiosk is illustrated. In some implementations, the cake customizationUI screens (FIGS. 6A-6R and 7A-7D) can be presented by consumer-facingdesign engine 210 to a consumer computing device 122 or kiosk 161connected directly to the system 100 b via network 118 or to a consumercomputing device 163 connected to the system 100 b through the kiosk.

In some implementations, upon logging in to the system 100, a consumeris presented with a landing page 502, such as UI screen 600 shown inFIG. 6A. The UI screen 600, in some examples, includes buttons or linksthat allow a consumer to select how to search for a type of cake toorder. In some examples, the selections include a photocake selectionlink 608 that allows the consumer to commence designing a cake thatincorporates a photo printed on a printed edible medium, a cake categorylink 612 that presents possible cake selections in categories (e.g.,birthday, anniversary, movie theme) that make it easier for the consumerto find a desired type of cake, and a cake finder link 606 that allowsthe consumer to input filter criteria that are used to present acustomized set of cake selections to the consumer based on consumerpreferences. Additionally, the UI screen 600 includes a bakery selectionlink 610 and a rapid order link 602 that allows consumers to view thetypes of cakes that are available for same-day pickup.

Returning to FIGS. 5A-B, based upon the selection made at the landingpage 502, the consumer-facing design engine 210 presents a cake searchscreen that allows the consumer to more efficiently search for andidentify a desired cake product. The cake search screens, in someexamples, include a photocake selection screen 504, a cake categorysearch screen 506, and a customized cake finder search screen 508. Insome implementations, the consumer-facing design engine presents aproduct list 512 that for photocakes or a particular cake category. If,in some embodiments, the consumer uses the customized cake findersearch, the consumer-facing design engine 210 returns a set ofcustomized cake offerings 510 that correspond to the filter inputsprovided by the consumer. Once the consumer selects a desired cakeproduct from those presented in the product list 512 or customized cakeofferings 510, the consumer-facing design engine 210 displays a productdetail 514 of the selected cake product, which may include a productphoto, customization options, price, and nutrition information.

For example, FIG. 6B shows a photocake selection UI screen 614 that isdisplayed when photocake selection 608 is made at UI screen 600 (FIG.6A). The photocake selection UI screen 614 can include a link 616 forcreating a cake that includes an uploaded photo and frame as well as alink 618 for incorporating an uploaded photo into a design that includesone or more image files. FIG. 6C shows a customized cake finder searchUI screen 620 that the consumer-facing design engine 210 presents inresponse to selection of cake finder link 606 in UI screen 600 (FIG.6A). In some examples, the cake finder UI screen 620 includes filterinputs 622 that allow the consumer to specify an occasion for orderingthe cake (e.g., birthday, anniversary), an age or gender of the cakerecipient, same-day pickup ordering, or photocake ordering. When the“show results” link 624 is selected, the cake products that correspondto the filter inputs are displayed. For example, FIG. 6D shows acustomized cake offering UI screen 626 with results that correspond tothe filter criteria submitted at UI screen 620. Once the consumerselects a desired cake product from those presented in UI screen 626,the consumer-facing design engine 210 displays product details for theselected cake product in a product details UI screen 628 as shown inFIG. 6E. The UI screen 628 may include a product photo 630, nutritioninformation 632, and the selected bakery 634 for pickup.

In some examples, if a bakery pickup location has not been selected, thelocation engine 222 presents a location selection UI screen, such as UIscreen 636 shown in FIG. 6F. The location selection UI screen 636includes a location information input field 638 where the consumerinputs a city and state or zip code, and the location engine 222produces a set of bakery results 640 that correspond to the locationinformation provided in the input field 638. In some examples, thebakery results 640 may be further refined to reflect the consumer'sdesired pickup date and cake product selections.

Returning to FIGS. 5A-B, if the consumer has selected the bakery pickuplocation 516, in some implementations, the consumer-facing design enginepresents a series of UI screens that allow the consumer to select a cakesize 518 and further customize the cake 520 by formatting text 522 andadding/editing at least one photo 524 to be added to the cake. In someexamples, if the text and picture have been added 526, then theconsumer-facing design engine presents UI screens that allow theconsumer to select a filling flavor 528 and customize an icing bordercolor and icing flavor 530. If, in some examples, the filling and icinghave been selected, the consumer-facing design engine 210 presents UIscreens that allow the consumer to select the cake flavor 534, previewthe customized cake 536, submit the cake product order 538, and receiveorder confirmation 538.

While the UI screen work flow described with respect to FIGS. 5A-Billustrate an ordering of one or more blocks or steps, it can beunderstood that that steps can be performed in any order, in series, orin parallel. For example, the customization UI screens may be presentedin any order. In one example, the consumer selects the cake flavor priorto selecting the filling or editing the text or photo. Further, in someembodiments, the bakery pickup location may be selected after the cakeproduct customization has been performed.

FIGS. 6G-6K and FIGS. 7A-7D illustrate cake product customization UIscreens. As shown in FIGS. 6G-6K, as the consumer makes each selectionfor customizing the cake product, the consumer-facing design engine 210updates a visual representation of the cake product 646, a listing ofall of the customization selections that have been made up to that point680, a price sub-total 648 that reflect all of the selections that havebeen made up to that point, and a “place order” link 650. In someexamples, the “place order” link is unavailable for selection until allof the customizable selections have been made (for example, as shown inFIG. 6L).

FIG. 6G illustrates a size selection UI screen 642 that includesselectable cake sizes 652. In some examples, each of the displayed cakesizes includes a number of people that the corresponding cake size isdesigned to serve. FIG. 6H illustrates a text and photo editing UIscreen 644 that provides the consumer the ability to add and edit textto be applied to the cake. For example, the UI screen 644 provides theability to add a photo to the cake design 661, edit font style 662, fontsize 654, color 656, and shape 658. As the consumer makes each textediting selection and/or photo selection, a mock-up 660 of the textand/or photograph presented on the cake is adjusted in real-time toreflect each edit that is made. FIG. 6O illustrates a portion of anexample text and photo editing UI screen 601 that provides additionalfeatures 603-611 related to photo editing. In some examples, theadditional features 603-611 are integrated into the UI screen 644 ofFIG. 6H. In some implementations, responsive to clicking on photolocation 611 of a cake mock-up 316 or an “add photo” selection 603,image editing engine 214 provides the user UI screens to upload a photofor placement within the photo location 611. Upon receiving a selectionof “remove photo” 605, the image editing engine 214 removes a previouslyselected image from the photo location 611. In some embodiments,responsive to receiving user inputs at resizing selectors 607, 609, theimage editing engine 214 increases or decreases a size of the photolocation 611 on the cake mock-up 613. For example, responsive toreceiving selection of a size reduction selector 607, the image editingengine 214 reduces the size of the photo location 611. In contrast, whenthe size enlarging selector 609 is selected, the size of the photolocation 611 is increased. FIG. 6I illustrates a cake filling selectionUI screen 664 that includes selectable cake filling flavors 670. FIG. 6Jillustrates an icing border color and icing flavor selection UI screen668 that includes selectable icing border colors 672 and icing flavors674. FIG. 6K illustrates a cake flavor selection UI screen 676 thatincludes selectable cake flavors 681.

FIGS. 7A-7D illustrate photo editing UI screens 700-706 that allowconsumers to take or upload a photo to be applied to an edible mediumfor the cake product. For example, photo editing UI screen 700 shown inFIG. 7A includes links for selecting whether to take a photo 708 withthe built-in or connected camera on the device or search for a photo ina photo library 710. If the take a photo link 708 is selected, then UIscreen 702 shown in FIG. 7B is presented, which allows the consumer toobtain a photo with the device camera to be printed on the edible media.If the photo library link 710 is selected in the photo editing UI screen700 of FIG. 7A, then a photo library UI screen 704 is presented, whichallows the consumer to select a photo that is stored in memory of thedevice. Once the desired photo is obtained, then the consumer-facingdesign engine 210 presents photo editing UI screen 706 as shown in FIG.7D, which allows the consumer to crop the selected photo to fit withinboundaries set by the edible medium associated with the selected cakeproduct.

FIG. 6L illustrates an order review UI screen 678 that allows theconsumer to view a visual representation of the completed cake product646, a listing of all of the customization selections that have beenmade for the completed cake product 680, a price sub-total 648 for thecake, a price total 682 that reflects the price of the cake product andany additional accessory items 690 selected by the consumer (e.g.,birthday candles), and a “place order” link 650. In someimplementations, the order review UI screen 678 also includes inputfields for selecting a pickup date 684, providing a note to the bakery686, providing contact information for the consumer 688, and selectingaccessory items 690. In one example, the input field for selecting thepickup date 684 can be provided to the consumer earlier in thecustomization process, such as at the UI screen 600 (FIG. 6A). When theplace order link 650 is selected, in some embodiments, the customizedcake order is submitted to the system 100, and the consumer-facingdesign engine 210 presents an order confirmation UI screen 692 as shownin FIG. 6M. The order confirmation UI screen 692 provides a notificationto the consumer that the customized cake product order has beensubmitted to the selected bakery.

FIG. 6N illustrates an account creation UI screen 694. In someembodiments, if a first-time consumer is interacting with the system100, the user account engine 218 presents the account creation UI screen692 at the consumer computing device 122, which allows the consumer toprovide credentials (e.g., email address, password) for logging in tothe system 696. In some implementations, consumers may also create anaccount by linking the account to an existing social media account 698.In some embodiments, a consumer who already has an account can select alogin link 699 to be directed to an account login UI screen for existingconsumers.

Turning to FIG. 8, a bakery administrative UI screen 800 is illustrated.In some implementations, the customer administration engine 238 receivesdecorating instructions and 2D or 3D edible media print data forcustomized food product orders from the central control device 132 anddisplays information for incoming customized cake product orders on thebakery administrative UI screen 800. In one example, the UI screen 800includes a summary section 802 that displays total numbers of neworders, orders accepted by the bakery, cancelled orders, and completedorders over a predetermined period of time (e.g., one day, one week).

In some implementations, the bakery administrative UI screen 800 canalso include an order detail section 804 that displays attributes of theorder, which can include an order identification number, a pickup date,a descriptive name for the food product, a price, an order source (e.g.,consumer computing device, kiosk), and a current status. In someimplementations, when a bakery/deli employee or other user clicks on theattributes of a particular order, the bakery administrative engine 238displays the decorating instructions for the customized food product aswell as a link to access any 2D or 3D edible media print data. In theexample shown in FIG. 8, the order detail section 804 displays theattributes of the most recently received orders at the bakery. In otherexamples, the order detail section 804 can display the attributes forreceived orders in a priority order for processing. For example, thepriority processing order can be based on a number of factors that mayinclude pickup date, order reception date, type of edible media for theorder, inventory at the bakery, preparation lead time for the order, anddetails for other orders that are in progress at the bakery. In someexamples, the bakery administrative engine 238 adjusts the processingorder for the orders displayed in the order detail section 804 inreal-time to reflect an optimal processing order for all orders thathave been received at the bakery.

System Hardware

Next, a hardware description of the computing device, mobile computingdevice, or server according to exemplary embodiments is described withreference to FIG. 9. In FIG. 9, the computing device, mobile computingdevice, or server includes a CPU 900 which performs the processes of thecentral control device 132, local control device 128, consumer computingdevice 122, and/or kiosk 161 (FIG. 1) described above. The process dataand instructions may be stored in memory 902. These processes andinstructions may also be stored on a storage medium disk 904 (forexample, data repository 129 in system 100) such as a hard drive (HDD)or portable storage medium or may be stored remotely. Further, theclaimed advancements are not limited by the form of thecomputer-readable media on which the instructions of the inventiveprocess are stored. For example, the instructions may be stored on CDs,DVDs, in FLASH memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk or anyother information processing device with which the computing device,mobile computing device, or server communicates, such as a server orcomputer.

Further, a portion of the claimed advancements may be provided as autility application, background daemon, or component of an operatingsystem, or combination thereof, executing in conjunction with CPU 900and an operating system such as Microsoft Windows, UNIX, Solaris, LINUX,Apple MAC-OS and other systems known to those skilled in the art.

CPU 900 may be a Xenon or Core processor from Intel of America or anOpteron processor from AMD of America, or may be other processor typesthat would be recognized by one of ordinary skill in the art.Alternatively, the CPU 900 may be implemented on an FPGA, ASIC, PLD orusing discrete logic circuits, as one of ordinary skill in the art wouldrecognize. Further, CPU 900 may be implemented as multiple processorscooperatively working in parallel to perform the instructions of theinventive processes described above.

The computing device, mobile computing device, or server in FIG. 9 alsoincludes a network controller 906, such as an Intel Ethernet PRO networkinterface card from Intel Corporation of America, for interfacing withnetwork 928. As can be appreciated, the network 928 can be a publicnetwork, such as the Internet, or a private network such as an LAN orWAN network, or any combination thereof and can also include PSTN orISDN sub-networks. The network 928 can also be wired, such as anEthernet network, or can be wireless such as a cellular networkincluding EDGE, 3G and 4G wireless cellular systems. The wirelessnetwork can also be Wi-Fi, Bluetooth, or any other wireless form ofcommunication that is known.

The computing device, mobile computing device, or server furtherincludes a display controller 908, such as a NVIDIA GeForce GTX orQuadro graphics adaptor from NVIDIA Corporation of America forinterfacing with display 910, such as a Hewlett Packard HPL2445w LCDmonitor. A general purpose I/O interface 912 interfaces with a keyboardand/or mouse 914 as well as a touch screen panel 916 on or separate fromdisplay 910. General purpose I/O interface also connects to a variety ofperipherals 918 including printers and scanners, such as edible mediaprinter 134 (FIG. 1).

A sound controller 920 is also provided in the computing device, mobilecomputing device, or server, such as Sound Blaster X-Fi Titanium fromCreative, to interface with speakers/microphone 922 thereby providingsounds and/or music.

The general purpose storage controller 924 connects the storage mediumdisk 904 with communication bus 926, which may be an ISA, EISA, VESA,PCI, or similar, for interconnecting all of the components of thecomputing device, mobile computing device, or server. A description ofthe general features and functionality of the display 910, keyboardand/or mouse 914, as well as the display controller 908, storagecontroller 924, network controller 906, sound controller 920, andgeneral purpose I/O interface 912 is omitted herein for brevity as thesefeatures are known.

One or more processors can be utilized to implement various functionsand/or algorithms described herein, unless explicitly stated otherwise.Additionally, any functions and/or algorithms described herein, unlessexplicitly stated otherwise, can be performed upon one or more virtualprocessors, for example on one or more physical computing systems suchas a computer farm or a cloud drive.

Reference has been made to flowchart illustrations and block diagrams ofmethods, systems and computer program products according toimplementations of this disclosure (for example, methods 300 and 400(FIGS. 3A-C and FIG. 4). Aspects thereof are implemented by computerprogram instructions. These computer program instructions may beprovided to a processor of a general purpose computer, special purposecomputer, or other programmable data processing apparatus to produce amachine, such that the instructions, which execute via the processor ofthe computer or other programmable data processing apparatus, createmeans for implementing the functions/acts specified in the flowchartand/or block diagram block or blocks.

These computer program instructions may also be stored in acomputer-readable medium that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablemedium produce an article of manufacture including instruction meanswhich implement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer orother programmable data processing apparatus to cause a series ofoperational steps to be performed on the computer or other programmableapparatus to produce a computer implemented process such that theinstructions which execute on the computer or other programmableapparatus provide processes for implementing the functions/actsspecified in the flowchart and/or block diagram block or blocks.

Moreover, the present disclosure is not limited to the specific circuitelements described herein, nor is the present disclosure limited to thespecific sizing and classification of these elements. For example, theskilled artisan will appreciate that the circuitry described herein maybe adapted based on changes on battery sizing and chemistry or based onthe requirements of the intended back-up load to be powered.

The functions and features described herein may also be executed byvarious distributed components of a system. For example, one or moreprocessors may execute these system functions, wherein the processorsare distributed across multiple components communicating in a network.The distributed components may include one or more client and servermachines, which may share processing, as shown on FIG. 10, in additionto various human interface and communication devices (e.g., displaymonitors, smart phones, tablets, personal digital assistants (PDAs)).The network may be a private network, such as a LAN or WAN, or may be apublic network, such as the Internet. Input to the system may bereceived via direct user input and received remotely either in real-timeor as a batch process. Additionally, some implementations may beperformed on modules or hardware not identical to those described.Accordingly, other implementations are within the scope that may beclaimed.

In some implementations, the described herein may interface with a cloudcomputing environment 1030 to perform at least portions of methods oralgorithms detailed above. The processes associated with the methodsdescribed herein can be executed on a computation processor by datacenter 1034. The data center 1034, for example, can also include anapplication processor that can be used as the interface with the systemsdescribed herein to receive data and output corresponding information.The cloud computing environment 1030 may also include one or moredatabases 1038 or other data storage, such as cloud storage and a querydatabase. In some implementations, the cloud storage database 1038 maystore processed and unprocessed data supplied by systems describedherein.

The systems described herein may communicate with the cloud computingenvironment 1030 through a secure gateway 1032. In some implementations,the secure gateway 1032 includes a database querying interface.

The cloud computing environment 1030 may include a provisioning tool1040 for resource management. The provisioning tool 1040 may beconnected to the computing devices of a data center 1034 to facilitatethe provision of computing resources of the data center 1034. Theprovisioning tool 1040 may receive a request for a computing resourcevia the secure gateway 1032 or a cloud controller 1036. The provisioningtool 1040 may facilitate a connection to a particular computing deviceof the data center 1034.

A network 1002 represents one or more networks, such as the Internet,connecting the cloud environment 1030 to a number of client devices suchas, in some examples, a cellular telephone 1010, a tablet computer 1012,a mobile computing device 1014, and a desktop computing device 1016. Thenetwork 1002 can also communicate via wireless networks using a varietyof mobile network services 1020 such as Wi-Fi, Bluetooth, cellularnetworks including EDGE, 3G and 4G wireless cellular systems, or anyother wireless form of communication that is known. The mobile networkservices 1020 can include a number of associated central processors1022, servers 1024, and databases 1026. In some implementations, theclient devices 1010, 1012, 1014 can connect to the mobile networkservices 1020 through access point 1054, base station 1056, and/orsatellite 1052. In some embodiments, the network 1002 is agnostic tolocal interfaces and networks associated with the client devices toallow for integration of the local interfaces and networks configured toperform the processes described herein.

While certain embodiments have been described, these embodiments havebeen presented by way of example only and are not intended to limit thescope of the present disclosures. Indeed, the novel methods, apparatusesand systems described herein can be embodied in a variety of otherforms; furthermore, various omissions, substitutions and changes in theform of the methods, apparatuses and systems described herein can bemade without departing from the spirit of the present disclosures. Theaccompanying claims and their equivalents are intended to cover suchforms or modifications as would fall within the scope and spirit of thepresent disclosures.

1. A system for designing and producing customized food products, thesystem comprising: processing circuitry; and a non-transitory computerreadable memory coupled to the processing circuitry, the memory storingmachine-executable instructions, wherein the machine-executableinstructions, when executed on the processing circuitry, cause theprocessing circuitry to receive, from a plurality of remote computingdevices via a first network, a plurality of requests from a plurality ofusers, each request to design a respective customized food productincorporating a respective printed edible medium, wherein each requestdesignates a preferred food product producer for picking up therespective customized food product upon completion, and each individualrequest of the plurality of requests is received at a different timethroughout a given day, for each of the plurality of requests,calculate, based in part on a current and/or anticipated availability ofa plurality of items in a product inventory at the preferred foodproduct producer, a preparation lead time for the respective customizedfood product, wherein the plurality of items includes a respectivesubstrate for the respective printed edible medium, prepare forpresentation, in real-time responsive to receiving the respectiverequest, one or more customization user interface screens to therespective remote computing device via the first network, wherein theone or more customization user interface screens provide one or morecustomization options for the respective customized food product, andwherein the one or more customization options are presented based inpart on the current and/or anticipated availability of at least one itemof the plurality of items in the product inventory at the preferred foodproduct producer, convert, responsive to receiving, via the firstnetwork from the respective remote computing device, an order submissionfor the respective customized food product, customization optionselections made at the one or more customization user interface screensinto respective decorating instructions for the respective customizedfood product, wherein the respective decorating instructions includerespective print data for printing onto a selected substrate at aprinter of the preferred food product producer, wherein converting thecustomization option selections into the respective print data includesgenerating the respective print data that is customized to one or moreproperties of a printer at the preferred food product producer, wherein customizing the respective print data comprises automaticallyadjusting, based on the properties of the printer, contents of a datafile for printing onto the respective substrate, determine, based inpart on attributes of the respective decorating instructions for therespective customized food product for each of the plurality ofrequests, a position in the preparation queue for each respectivecustomized food product, wherein determining the position in thepreparation queue for the respective customized food product includesdetermining a print queue position for the respective substrate forcreating the printed edible medium of the customized food product incoordination with the preparation lead time of the customized foodproduct into which the printed edible medium is to be incorporated, andwherein the print queue position is dynamically adjusted in real-time tomaximize throughput and efficiency at the printer based at least in parton both a preparation lead time for the customized food productassociated with the printed edible medium and the one or more propertiesof the printer; and transmit, responsive to receiving the ordersubmission for each respective customized food product, the respectivedecorating instructions and the position in the preparation queue to acomputing system at the preferred food product producer via a secondnetwork, wherein transmitting the respective decorating instructions tothe computing system includes transmitting the respective print dataincluding the data file for printing onto the respective substrate tothe printer.
 2. The system of claim 1, wherein the preferred foodproduct producer is a bakery or a deli.
 3. (canceled)
 4. The system ofclaim 1, wherein the machine-executable instructions, when executed onthe processing circuitry, further cause the processing circuitry to:receive, from the printer via the second network, a printer statussignal indicating amounts of edible ink within each of a plurality ofprint cartridges of the printer, and adjust the print queue position forprinting onto the respective substrate based on the respective amountsof the edible ink in the plurality of print cartridges being used at asubstantially similar rate.
 5. The system of claim 1, whereindetermining the print queue position for the respective substratecomprises determining the print queue position based on a type and sizeof substrate associated with the respective printed edible medium. 6.The system of claim 5, wherein determining the print queue position forthe respective substrate comprises positioning the respective substratein a printing queue such that the respective printed edible medium isprinted consecutively with other substrates of the same type and size.7. The system of claim 1, wherein the machine-executable instructions,when executed on the processing circuitry, further cause the processingcircuitry to: automatically transmit, responsive to determining that therespective printed edible medium occupies a highest print queueposition, the print data for the respective substrate to the printer ofthe preferred food product producer.
 8. The system of claim 1, whereinthe product inventory comprises current and/or anticipated quantities ofeach of the plurality of items maintained by the preferred food productproducer.
 9. The system of claim 8, wherein the plurality of items inthe product inventory comprises at least one of edible media, edibleink, replacement parts, printheads, food product ingredients, orconsumable decorating materials.
 10. The system of claim 8, wherein themachine-executable instructions, when executed on the processingcircuitry, further cause the processing circuitry to: automaticallyadjust in real-time, responsive to receiving a completion signal fromthe computing system at the preferred product producer indicating thatpreparation of the respective customized food product is complete, thequantities of respective items of the plurality of items used to producethe respective customized food product.
 11. The system of claim 10,wherein adjusting the quantities of the respective items comprisescomputing, based on attributes of the respective customized foodproduct, amounts of the respective inventory items used to produce therespective customized food product, and automatically adjusting inreal-time, the quantities of the respective items of the plurality ofitems based on the computed amounts.
 12. The system of claim 10, whereinthe machine-executable instructions, when executed on the processingcircuitry, further cause the processing circuitry to: automaticallyinitiate, at a third remote computing device of an inventory item vendorresponsive to adjusting the quantities of one or more of the respectiveitems to an amount less than a predetermined threshold, an order for theone or more of the respective items without interaction by a user at thepreferred product producer with the system.
 13. The system of claim 10,wherein the machine-executable instructions, when executed on theprocessing circuitry, further cause the processing circuitry to:automatically update, responsive to the adjusting of the quantities ofthe respective items, preparation lead times for each of the customizedfood products for the plurality of requests based on the updatedquantities of the respective items.
 14. The system of claim 1, whereinthe decorating instructions further comprise at least one of a recipe,ingredient amounts, edible media placement locations, or decorationplacement locations for producing the respective customized foodproduct.
 15. The system of claim 1, wherein converting the customizationoption selections into the respective decorating instructions for therespective customized food product comprises, when the respectiveprinted edible medium is a 3D printed edible medium, generating a finiteelement model of the respective printed edible medium from thecustomization option selections made at the one or more customizationuser interface screens.
 16. The system of claim 15, wherein convertingthe customization option selections into the respective decoratinginstructions for the respective customized food product furthercomprises determining, from the finite element model for the respectiveprinted edible medium, a center of mass and stability of the respectiveprinted edible medium.
 17. The system of claim 16, wherein themachine-executable instructions, when executed on the processingcircuitry, further cause the processing circuitry to: generate, from thefinite element model for the respective printed edible medium, assemblyinstructions for the respective printed edible medium, whereingenerating the assembly instructions comprises identifying at least oneof a base and attachment features for the respective printed ediblemedium based on the center of mass and the stability of the respectiveprinted edible medium.
 18. The system of claim 1, wherein the printer isone of a plurality of printers at the preferred product producer. 19.The system of claim 18, wherein the machine-executable instructions,when executed on the processing circuitry, further cause the processingcircuitry to: automatically select the printer from the plurality ofprinters at the preferred food product producer based on attributes ofat least one of the respective substrate or the customized food product.20. A method comprising: receiving, from a plurality of remote computingdevices via a first network, a plurality of requests from a plurality ofusers, each request to design a respective customized food productincorporating a respective printed edible medium, wherein each requestdesignates a preferred food product producer for picking up therespective customized food product upon completion, and each individualrequest of the plurality of requests is received at a different timethroughout a given day; for each of the plurality of requests,calculating, by processing circuitry based in part on current and/oranticipated availability of a plurality of items in a product inventoryat the preferred food product producer, a preparation lead time for therespective customized food product, wherein the plurality of itemsincludes a respective substrate for the respective printed ediblemedium; preparing for presentation, by the processing circuitry inreal-time responsive to receiving the respective request, one or morecustomization user interface screens to the respective computing devicevia the first network, wherein the one or more customization userinterface screens provide one or more customization options for therespective customized food product, and wherein the one or morecustomization options are presented based in part on the current and/oranticipated availability of at least one item of the plurality of itemsin the product inventory at the preferred food product producer;converting, by the processing circuitry responsive to receiving, via thefirst network from the respective remote computing device, an ordersubmission for the respective customized food product, customizationoption selections made at the one or more customization user interfacescreens into respective decorating instructions for the respectivecustomized food product, wherein the respective decorating instructionsinclude respective print data for printing onto a selected substrate ata printer of the preferred food product producer wherein converting thecustomization option selections into the respective print data includesgenerating the respective print data that is customized to one or moreproperties of the printer at the preferred food product producer,wherein customizing the respective print data comprises automaticallyadjusting, based on the properties of the printer, contents of a datafile for printing onto the respective substrate; determining, by theprocessing circuitry for each of the plurality of requests based in parton a type and size of the respective substrate, a position in a printqueue for printing onto each respective substrate by the printer,wherein the position in the print queue is dynamically adjusted inreal-time to maximize throughput and efficiency at the printer based atleast in part on both a preparation lead time for the customized foodproduct associated with the printed edible medium and the one or moreproperties of the printer; and automatically transmitting, by theprocessing circuitry responsive to determining that the respectivesubstrate occupies a highest position in the print queue, the respectiveprint data for the respective substrate to the printer of the preferredfood product producer via a second network, wherein transmitting therespective print data includes transmitting the data file for printingonto the respective substrate.
 21. The system of claim 1, whereinconverting the customization option selections into the respectivedecorating instructions includes dynamically adjusting, in real-timeresponsive to receiving adjusted customization selections for therespective customized food product at the one or more customization userinterface screens, ingredient amounts for preparing the respectivecustomized food product.
 22. The system of claim 1, wherein presentingthe one or more customization user interface screens to the first remotecomputing device comprises dynamically adjusting, in real-time based oningredient amounts allocated to other respective customized food productorders associated with other requests of the plurality of requestsassigned to the preferred food product producer, an availability of aportion of the one or more customization options for selection at theone or more customization user interface screens.
 23. The system ofclaim 1, wherein adjusting the contents of the data file for printingonto the respective substrate includes applying color matching andcorrection to the data file based on the properties of the detectedprinter.
 24. The system of claim 1, wherein the machine-executableinstructions, when executed on the processing circuitry, further causethe processing circuitry to: receive, from the printer via the secondnetwork, a printer status signal indicating a current status of aportion of the one or more printer properties; and dynamically adjustthe print queue position for printing onto the respective substrate tomaximize throughput and efficiency at the printer based on the currentstatus indicated in the printer status signal.
 25. The system of claim1, wherein the machine-executable instructions, when executed on theprocessing circuitry, further cause the processing circuitry to:automatically detect, via the second network, the printercommunicatively coupled to the respective remote computing device; anddetermine, responsive to automatically detecting the printer, the one ormore properties of the detected printer.